2026-03-17 16:33:51,582 p=37681 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace 2026-03-17 16:33:51,582 p=37681 u=zuul n=ansible | PLAY [Verify logging journalctl identifiers] *********************************** 2026-03-17 16:33:51,590 p=37681 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-17 16:33:51,591 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:51 +0000 (0:00:00.011) 0:00:00.011 ********* 2026-03-17 16:33:53,843 p=37681 u=zuul n=ansible | ok: [compute-0] 2026-03-17 16:33:53,888 p=37681 u=zuul n=ansible | TASK [telemetry_logging : Verify journal entries] ****************************** 2026-03-17 16:33:53,889 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:53 +0000 (0:00:02.297) 0:00:02.309 ********* 2026-03-17 16:33:53,952 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=ceilometer_agent_compute) 2026-03-17 16:33:53,954 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=nova_compute) 2026-03-17 16:33:53,967 p=37681 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX] *** 2026-03-17 16:33:53,967 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:53 +0000 (0:00:00.078) 0:00:02.387 ********* 2026-03-17 16:33:54,850 p=37681 u=zuul n=ansible | ok: [compute-0] 2026-03-17 16:33:54,861 p=37681 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX] *** 2026-03-17 16:33:54,861 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:54 +0000 (0:00:00.894) 0:00:03.282 ********* 2026-03-17 16:33:54,898 p=37681 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed!" } 2026-03-17 16:33:54,910 p=37681 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute RHOSO-XXX] ************* 2026-03-17 16:33:54,910 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:54 +0000 (0:00:00.048) 0:00:03.330 ********* 2026-03-17 16:33:57,283 p=37681 u=zuul n=ansible | ok: [compute-0] 2026-03-17 16:33:57,341 p=37681 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute RHOSO-XXX] ************* 2026-03-17 16:33:57,341 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:57 +0000 (0:00:02.431) 0:00:05.762 ********* 2026-03-17 16:33:57,411 p=37681 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed!" } 2026-03-17 16:33:57,426 p=37681 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 16:33:57,426 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:57 +0000 (0:00:00.084) 0:00:05.846 ********* 2026-03-17 16:33:57,441 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:33:57,451 p=37681 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 16:33:57,451 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:57 +0000 (0:00:00.024) 0:00:05.871 ********* 2026-03-17 16:33:57,468 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:33:57,476 p=37681 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 16:33:57,477 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:57 +0000 (0:00:00.025) 0:00:05.897 ********* 2026-03-17 16:33:57,493 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:33:57,502 p=37681 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 16:33:57,502 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:57 +0000 (0:00:00.025) 0:00:05.923 ********* 2026-03-17 16:33:57,520 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:33:57,529 p=37681 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 16:33:57,529 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:57 +0000 (0:00:00.026) 0:00:05.950 ********* 2026-03-17 16:33:57,546 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:33:57,555 p=37681 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 16:33:57,555 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:57 +0000 (0:00:00.026) 0:00:05.976 ********* 2026-03-17 16:33:57,585 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/file_tests.yml for compute-0 => (item=/etc/rsyslog.d/10-telemetry.conf) 2026-03-17 16:33:57,595 p=37681 u=zuul n=ansible | TASK [common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf"] ******** 2026-03-17 16:33:57,595 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:57 +0000 (0:00:00.039) 0:00:06.015 ********* 2026-03-17 16:33:58,354 p=37681 u=zuul n=ansible | ok: [compute-0] 2026-03-17 16:33:58,369 p=37681 u=zuul n=ansible | TASK [common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists] *** 2026-03-17 16:33:58,369 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:58 +0000 (0:00:00.774) 0:00:06.789 ********* 2026-03-17 16:33:58,430 p=37681 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed" } 2026-03-17 16:33:58,441 p=37681 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 16:33:58,441 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:58 +0000 (0:00:00.072) 0:00:06.862 ********* 2026-03-17 16:33:58,461 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:33:58,472 p=37681 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 16:33:58,473 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:58 +0000 (0:00:00.031) 0:00:06.893 ********* 2026-03-17 16:33:58,497 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:33:58,507 p=37681 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 16:33:58,507 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:58 +0000 (0:00:00.034) 0:00:06.927 ********* 2026-03-17 16:33:58,527 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:33:58,537 p=37681 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 16:33:58,537 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:58 +0000 (0:00:00.030) 0:00:06.958 ********* 2026-03-17 16:33:58,557 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:33:58,564 p=37681 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 16:33:58,564 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:58 +0000 (0:00:00.026) 0:00:06.984 ********* 2026-03-17 16:33:58,581 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:33:58,610 p=37681 u=zuul n=ansible | PLAY [Run container tests which require root on compute nodes] ***************** 2026-03-17 16:33:58,618 p=37681 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-17 16:33:58,618 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:33:58 +0000 (0:00:00.054) 0:00:07.039 ********* 2026-03-17 16:34:00,336 p=37681 u=zuul n=ansible | ok: [compute-0] 2026-03-17 16:34:00,355 p=37681 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 16:34:00,355 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:01.736) 0:00:08.775 ********* 2026-03-17 16:34:00,388 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:00,395 p=37681 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 16:34:00,395 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:00.040) 0:00:08.816 ********* 2026-03-17 16:34:00,425 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:00,433 p=37681 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 16:34:00,433 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:00.037) 0:00:08.853 ********* 2026-03-17 16:34:00,452 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:00,462 p=37681 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 16:34:00,462 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:00.029) 0:00:08.882 ********* 2026-03-17 16:34:00,481 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:00,491 p=37681 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 16:34:00,491 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:00.029) 0:00:08.912 ********* 2026-03-17 16:34:00,515 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:00,523 p=37681 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 16:34:00,523 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:00.031) 0:00:08.943 ********* 2026-03-17 16:34:00,545 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:00,554 p=37681 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 16:34:00,554 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:00.030) 0:00:08.974 ********* 2026-03-17 16:34:00,576 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:00,585 p=37681 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 16:34:00,585 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:00.031) 0:00:09.006 ********* 2026-03-17 16:34:00,605 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:00,615 p=37681 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 16:34:00,616 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:00.030) 0:00:09.036 ********* 2026-03-17 16:34:00,634 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:00,643 p=37681 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 16:34:00,643 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:00.027) 0:00:09.064 ********* 2026-03-17 16:34:00,660 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:00,669 p=37681 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 16:34:00,669 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:00.025) 0:00:09.089 ********* 2026-03-17 16:34:00,700 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=ceilometer_agent_compute) 2026-03-17 16:34:00,703 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=node_exporter) 2026-03-17 16:34:00,710 p=37681 u=zuul n=ansible | TASK [common : Get container status] ******************************************* 2026-03-17 16:34:00,710 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:00 +0000 (0:00:00.040) 0:00:09.130 ********* 2026-03-17 16:34:01,391 p=37681 u=zuul n=ansible | ok: [compute-0] 2026-03-17 16:34:01,398 p=37681 u=zuul n=ansible | TASK [common : Show the container name and status] ***************************** 2026-03-17 16:34:01,398 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:01 +0000 (0:00:00.688) 0:00:09.819 ********* 2026-03-17 16:34:01,432 p=37681 u=zuul n=ansible | ok: [compute-0] => { "container_status.stdout": "ceilometer_agent_compute Up 4 minutes (healthy)" } 2026-03-17 16:34:01,440 p=37681 u=zuul n=ansible | TASK [common : Show the containers] ******************************************** 2026-03-17 16:34:01,441 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:01 +0000 (0:00:00.042) 0:00:09.861 ********* 2026-03-17 16:34:01,480 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:01,487 p=37681 u=zuul n=ansible | TASK [common : Show the output of container list] ****************************** 2026-03-17 16:34:01,487 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:01 +0000 (0:00:00.046) 0:00:09.908 ********* 2026-03-17 16:34:01,520 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:01,529 p=37681 u=zuul n=ansible | TASK [common : TEST Verify ceilometer_agent_compute container status] ********** 2026-03-17 16:34:01,530 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:01 +0000 (0:00:00.042) 0:00:09.950 ********* 2026-03-17 16:34:01,574 p=37681 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "Container 'ceilometer_agent_compute' is in 'healthy' status." } 2026-03-17 16:34:01,589 p=37681 u=zuul n=ansible | TASK [common : Get container status] ******************************************* 2026-03-17 16:34:01,590 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:01 +0000 (0:00:00.060) 0:00:10.010 ********* 2026-03-17 16:34:02,387 p=37681 u=zuul n=ansible | ok: [compute-0] 2026-03-17 16:34:02,404 p=37681 u=zuul n=ansible | TASK [common : Show the container name and status] ***************************** 2026-03-17 16:34:02,405 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:02 +0000 (0:00:00.814) 0:00:10.825 ********* 2026-03-17 16:34:02,438 p=37681 u=zuul n=ansible | ok: [compute-0] => { "container_status.stdout": "node_exporter Up 4 minutes (healthy)" } 2026-03-17 16:34:02,458 p=37681 u=zuul n=ansible | TASK [common : Show the containers] ******************************************** 2026-03-17 16:34:02,458 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:02 +0000 (0:00:00.053) 0:00:10.878 ********* 2026-03-17 16:34:02,506 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:02,516 p=37681 u=zuul n=ansible | TASK [common : Show the output of container list] ****************************** 2026-03-17 16:34:02,516 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:02 +0000 (0:00:00.057) 0:00:10.936 ********* 2026-03-17 16:34:02,556 p=37681 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 16:34:02,569 p=37681 u=zuul n=ansible | TASK [common : TEST Verify node_exporter container status] ********************* 2026-03-17 16:34:02,569 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:02 +0000 (0:00:00.053) 0:00:10.990 ********* 2026-03-17 16:34:02,605 p=37681 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "Container 'node_exporter' is in 'healthy' status." } 2026-03-17 16:34:02,640 p=37681 u=zuul n=ansible | PLAY [Verify logging projects, endpoints, credentials, nodes, pods, services, manifests and subscriptions] *** 2026-03-17 16:34:02,649 p=37681 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 16:34:02,649 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:02 +0000 (0:00:00.079) 0:00:11.069 ********* 2026-03-17 16:34:02,686 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-operator-controller-manager) 2026-03-17 16:34:02,688 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstack-operator-controller-manager) 2026-03-17 16:34:02,695 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:34:02,695 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:02 +0000 (0:00:00.046) 0:00:11.116 ********* 2026-03-17 16:34:03,596 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:03,603 p=37681 u=zuul n=ansible | TASK [common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace] *** 2026-03-17 16:34:03,604 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:03 +0000 (0:00:00.908) 0:00:12.024 ********* 2026-03-17 16:34:04,186 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:04,192 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:34:04,192 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:04 +0000 (0:00:00.588) 0:00:12.613 ********* 2026-03-17 16:34:04,823 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:04,830 p=37681 u=zuul n=ansible | TASK [common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace] *** 2026-03-17 16:34:04,830 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:04 +0000 (0:00:00.638) 0:00:13.251 ********* 2026-03-17 16:34:05,441 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:05,445 p=37681 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 16:34:05,445 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:05 +0000 (0:00:00.614) 0:00:13.865 ********* 2026-03-17 16:34:05,476 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/subscription_tests.yml for controller => (item=loki-operator) 2026-03-17 16:34:05,487 p=37681 u=zuul n=ansible | TASK [common : Verify subscription "loki-operator"] **************************** 2026-03-17 16:34:05,488 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:05 +0000 (0:00:00.042) 0:00:13.908 ********* 2026-03-17 16:34:06,094 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:06,100 p=37681 u=zuul n=ansible | TASK [common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace] *** 2026-03-17 16:34:06,100 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:06 +0000 (0:00:00.612) 0:00:14.521 ********* 2026-03-17 16:34:06,122 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "subscription loki-operator is found." } 2026-03-17 16:34:06,126 p=37681 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 16:34:06,126 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:06 +0000 (0:00:00.025) 0:00:14.546 ********* 2026-03-17 16:34:06,214 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'public']) 2026-03-17 16:34:06,216 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'internal']) 2026-03-17 16:34:06,219 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'public']) 2026-03-17 16:34:06,221 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'internal']) 2026-03-17 16:34:06,224 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'public']) 2026-03-17 16:34:06,227 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'internal']) 2026-03-17 16:34:06,230 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'public']) 2026-03-17 16:34:06,233 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'internal']) 2026-03-17 16:34:06,235 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'public']) 2026-03-17 16:34:06,238 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'internal']) 2026-03-17 16:34:06,240 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'public']) 2026-03-17 16:34:06,242 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'internal']) 2026-03-17 16:34:06,244 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'public']) 2026-03-17 16:34:06,245 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'internal']) 2026-03-17 16:34:06,247 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'public']) 2026-03-17 16:34:06,249 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'internal']) 2026-03-17 16:34:06,261 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'public']"] **************** 2026-03-17 16:34:06,261 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:06 +0000 (0:00:00.134) 0:00:14.681 ********* 2026-03-17 16:34:09,096 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:09,103 p=37681 u=zuul n=ansible | TASK [common : TEST Check that nova public endpoint exists] ******************** 2026-03-17 16:34:09,103 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:09 +0000 (0:00:02.842) 0:00:17.524 ********* 2026-03-17 16:34:09,134 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint nova is found." } 2026-03-17 16:34:09,141 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'internal']"] ************** 2026-03-17 16:34:09,142 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:09 +0000 (0:00:00.038) 0:00:17.562 ********* 2026-03-17 16:34:12,384 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:12,391 p=37681 u=zuul n=ansible | TASK [common : TEST Check that nova internal endpoint exists] ****************** 2026-03-17 16:34:12,391 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:12 +0000 (0:00:03.249) 0:00:20.811 ********* 2026-03-17 16:34:12,427 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint nova is found." } 2026-03-17 16:34:12,434 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'public']"] ********* 2026-03-17 16:34:12,435 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:12 +0000 (0:00:00.043) 0:00:20.855 ********* 2026-03-17 16:34:15,411 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:15,419 p=37681 u=zuul n=ansible | TASK [common : TEST Check that placement public endpoint exists] *************** 2026-03-17 16:34:15,420 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:15 +0000 (0:00:02.984) 0:00:23.840 ********* 2026-03-17 16:34:15,447 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint placement is found." } 2026-03-17 16:34:15,454 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'internal']"] ******* 2026-03-17 16:34:15,454 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:15 +0000 (0:00:00.034) 0:00:23.875 ********* 2026-03-17 16:34:18,210 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:18,216 p=37681 u=zuul n=ansible | TASK [common : TEST Check that placement internal endpoint exists] ************* 2026-03-17 16:34:18,216 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:18 +0000 (0:00:02.762) 0:00:26.637 ********* 2026-03-17 16:34:18,241 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint placement is found." } 2026-03-17 16:34:18,248 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'public']"] ********** 2026-03-17 16:34:18,248 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:18 +0000 (0:00:00.032) 0:00:26.669 ********* 2026-03-17 16:34:21,199 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:21,206 p=37681 u=zuul n=ansible | TASK [common : TEST Check that swift public endpoint exists] ******************* 2026-03-17 16:34:21,206 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:21 +0000 (0:00:02.957) 0:00:29.627 ********* 2026-03-17 16:34:21,223 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint swift is found." } 2026-03-17 16:34:21,228 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'internal']"] ******** 2026-03-17 16:34:21,228 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:21 +0000 (0:00:00.021) 0:00:29.648 ********* 2026-03-17 16:34:23,888 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:23,904 p=37681 u=zuul n=ansible | TASK [common : TEST Check that swift internal endpoint exists] ***************** 2026-03-17 16:34:23,904 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:23 +0000 (0:00:02.676) 0:00:32.325 ********* 2026-03-17 16:34:23,930 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint swift is found." } 2026-03-17 16:34:23,938 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'public']"] *********** 2026-03-17 16:34:23,938 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:23 +0000 (0:00:00.033) 0:00:32.358 ********* 2026-03-17 16:34:26,860 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:26,868 p=37681 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 public endpoint exists] **************** 2026-03-17 16:34:26,868 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:26 +0000 (0:00:02.929) 0:00:35.288 ********* 2026-03-17 16:34:26,889 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint cinderv3 is found." } 2026-03-17 16:34:26,896 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'internal']"] ********* 2026-03-17 16:34:26,896 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:26 +0000 (0:00:00.028) 0:00:35.316 ********* 2026-03-17 16:34:30,027 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:30,033 p=37681 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 internal endpoint exists] ************** 2026-03-17 16:34:30,034 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:30 +0000 (0:00:03.137) 0:00:38.454 ********* 2026-03-17 16:34:30,053 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint cinderv3 is found." } 2026-03-17 16:34:30,060 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'public']"] ******** 2026-03-17 16:34:30,060 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:30 +0000 (0:00:00.026) 0:00:38.480 ********* 2026-03-17 16:34:32,748 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:32,755 p=37681 u=zuul n=ansible | TASK [common : TEST Check that barbican public endpoint exists] **************** 2026-03-17 16:34:32,755 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:32 +0000 (0:00:02.695) 0:00:41.176 ********* 2026-03-17 16:34:32,779 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint barbican is found." } 2026-03-17 16:34:32,786 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'internal']"] ****** 2026-03-17 16:34:32,786 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:32 +0000 (0:00:00.030) 0:00:41.206 ********* 2026-03-17 16:34:35,784 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:35,792 p=37681 u=zuul n=ansible | TASK [common : TEST Check that barbican internal endpoint exists] ************** 2026-03-17 16:34:35,793 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:35 +0000 (0:00:03.006) 0:00:44.213 ********* 2026-03-17 16:34:35,817 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint barbican is found." } 2026-03-17 16:34:35,824 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'public']"] *********** 2026-03-17 16:34:35,824 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:35 +0000 (0:00:00.031) 0:00:44.244 ********* 2026-03-17 16:34:38,629 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:38,635 p=37681 u=zuul n=ansible | TASK [common : TEST Check that keystone public endpoint exists] **************** 2026-03-17 16:34:38,635 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:38 +0000 (0:00:02.810) 0:00:47.055 ********* 2026-03-17 16:34:38,660 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint keystone is found." } 2026-03-17 16:34:38,665 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'internal']"] ********* 2026-03-17 16:34:38,666 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:38 +0000 (0:00:00.030) 0:00:47.086 ********* 2026-03-17 16:34:41,424 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:41,439 p=37681 u=zuul n=ansible | TASK [common : TEST Check that keystone internal endpoint exists] ************** 2026-03-17 16:34:41,439 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:41 +0000 (0:00:02.773) 0:00:49.860 ********* 2026-03-17 16:34:41,468 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint keystone is found." } 2026-03-17 16:34:41,481 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'public']"] **************** 2026-03-17 16:34:41,482 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:41 +0000 (0:00:00.042) 0:00:49.902 ********* 2026-03-17 16:34:44,474 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:44,479 p=37681 u=zuul n=ansible | TASK [common : TEST Check that glance public endpoint exists] ****************** 2026-03-17 16:34:44,480 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:44 +0000 (0:00:02.997) 0:00:52.900 ********* 2026-03-17 16:34:44,506 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint glance is found." } 2026-03-17 16:34:44,512 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'internal']"] ************** 2026-03-17 16:34:44,512 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:44 +0000 (0:00:00.032) 0:00:52.932 ********* 2026-03-17 16:34:47,976 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:47,985 p=37681 u=zuul n=ansible | TASK [common : TEST Check that glance internal endpoint exists] **************** 2026-03-17 16:34:47,986 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:47 +0000 (0:00:03.473) 0:00:56.406 ********* 2026-03-17 16:34:48,011 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint glance is found." } 2026-03-17 16:34:48,018 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'public']"] ************* 2026-03-17 16:34:48,019 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:48 +0000 (0:00:00.033) 0:00:56.439 ********* 2026-03-17 16:34:51,283 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:51,290 p=37681 u=zuul n=ansible | TASK [common : TEST Check that neutron public endpoint exists] ***************** 2026-03-17 16:34:51,290 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:51 +0000 (0:00:03.271) 0:00:59.711 ********* 2026-03-17 16:34:51,315 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint neutron is found." } 2026-03-17 16:34:51,322 p=37681 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'internal']"] *********** 2026-03-17 16:34:51,322 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:51 +0000 (0:00:00.031) 0:00:59.742 ********* 2026-03-17 16:34:54,152 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:54,159 p=37681 u=zuul n=ansible | TASK [common : TEST Check that neutron internal endpoint exists] *************** 2026-03-17 16:34:54,160 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:54 +0000 (0:00:02.837) 0:01:02.580 ********* 2026-03-17 16:34:54,178 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint neutron is found." } 2026-03-17 16:34:54,183 p=37681 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 16:34:54,183 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:54 +0000 (0:00:00.023) 0:01:02.603 ********* 2026-03-17 16:34:54,217 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-openstack-infra) 2026-03-17 16:34:54,219 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift) 2026-03-17 16:34:54,221 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openstack-operators) 2026-03-17 16:34:54,223 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-logging) 2026-03-17 16:34:54,250 p=37681 u=zuul n=ansible | TASK [common : Get the openshift-openstack-infra project] ********************** 2026-03-17 16:34:54,250 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:54 +0000 (0:00:00.067) 0:01:02.670 ********* 2026-03-17 16:34:54,771 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:54,776 p=37681 u=zuul n=ansible | TASK [common : TEST Verify openshift-openstack-infra project exists] *********** 2026-03-17 16:34:54,776 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:54 +0000 (0:00:00.526) 0:01:03.197 ********* 2026-03-17 16:34:54,800 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift-openstack-infra is found." } 2026-03-17 16:34:54,805 p=37681 u=zuul n=ansible | TASK [common : Get the openshift project] ************************************** 2026-03-17 16:34:54,805 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:54 +0000 (0:00:00.028) 0:01:03.226 ********* 2026-03-17 16:34:55,381 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:55,387 p=37681 u=zuul n=ansible | TASK [common : TEST Verify openshift project exists] *************************** 2026-03-17 16:34:55,387 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:55 +0000 (0:00:00.581) 0:01:03.808 ********* 2026-03-17 16:34:55,406 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift is found." } 2026-03-17 16:34:55,412 p=37681 u=zuul n=ansible | TASK [common : Get the openstack-operators project] **************************** 2026-03-17 16:34:55,412 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:55 +0000 (0:00:00.024) 0:01:03.832 ********* 2026-03-17 16:34:55,976 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:55,983 p=37681 u=zuul n=ansible | TASK [common : TEST Verify openstack-operators project exists] ***************** 2026-03-17 16:34:55,984 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:55 +0000 (0:00:00.571) 0:01:04.404 ********* 2026-03-17 16:34:56,002 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openstack-operators is found." } 2026-03-17 16:34:56,007 p=37681 u=zuul n=ansible | TASK [common : Get the openshift-logging project] ****************************** 2026-03-17 16:34:56,007 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:56 +0000 (0:00:00.023) 0:01:04.428 ********* 2026-03-17 16:34:56,609 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:56,615 p=37681 u=zuul n=ansible | TASK [common : TEST Verify openshift-logging project exists] ******************* 2026-03-17 16:34:56,615 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:56 +0000 (0:00:00.607) 0:01:05.035 ********* 2026-03-17 16:34:56,639 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift-logging is found." } 2026-03-17 16:34:56,643 p=37681 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 16:34:56,643 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:56 +0000 (0:00:00.028) 0:01:05.063 ********* 2026-03-17 16:34:56,758 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=cluster-logging-operator-metrics) 2026-03-17 16:34:56,760 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-grpc) 2026-03-17 16:34:56,763 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-http) 2026-03-17 16:34:56,766 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-grpc) 2026-03-17 16:34:56,768 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-http) 2026-03-17 16:34:56,771 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gateway-http) 2026-03-17 16:34:56,773 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gossip-ring) 2026-03-17 16:34:56,776 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-grpc) 2026-03-17 16:34:56,778 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-http) 2026-03-17 16:34:56,780 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-grpc) 2026-03-17 16:34:56,783 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-http) 2026-03-17 16:34:56,785 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-grpc) 2026-03-17 16:34:56,788 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-http) 2026-03-17 16:34:56,789 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-grpc) 2026-03-17 16:34:56,791 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-http) 2026-03-17 16:34:56,793 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=openstack-logging) 2026-03-17 16:34:56,823 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "cluster-logging-operator-metrics"] ************ 2026-03-17 16:34:56,823 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:56 +0000 (0:00:00.179) 0:01:05.243 ********* 2026-03-17 16:34:57,385 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:57,391 p=37681 u=zuul n=ansible | TASK [common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace] *** 2026-03-17 16:34:57,391 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:57 +0000 (0:00:00.567) 0:01:05.811 ********* 2026-03-17 16:34:57,412 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service cluster-logging-operator-metrics is running." } 2026-03-17 16:34:57,416 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-grpc"] ***************** 2026-03-17 16:34:57,417 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:57 +0000 (0:00:00.025) 0:01:05.837 ********* 2026-03-17 16:34:57,991 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:57,997 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace] *** 2026-03-17 16:34:57,997 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:57 +0000 (0:00:00.580) 0:01:06.417 ********* 2026-03-17 16:34:58,021 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-compactor-grpc is running." } 2026-03-17 16:34:58,027 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-http"] ***************** 2026-03-17 16:34:58,027 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:58 +0000 (0:00:00.029) 0:01:06.447 ********* 2026-03-17 16:34:58,613 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:58,622 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace] *** 2026-03-17 16:34:58,622 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:58 +0000 (0:00:00.595) 0:01:07.042 ********* 2026-03-17 16:34:58,642 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-compactor-http is running." } 2026-03-17 16:34:58,648 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-grpc"] *************** 2026-03-17 16:34:58,648 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:58 +0000 (0:00:00.026) 0:01:07.069 ********* 2026-03-17 16:34:59,194 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:59,199 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace] *** 2026-03-17 16:34:59,200 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:59 +0000 (0:00:00.551) 0:01:07.620 ********* 2026-03-17 16:34:59,219 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-distributor-grpc is running." } 2026-03-17 16:34:59,224 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-http"] *************** 2026-03-17 16:34:59,224 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:59 +0000 (0:00:00.024) 0:01:07.644 ********* 2026-03-17 16:34:59,757 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:34:59,762 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace] *** 2026-03-17 16:34:59,762 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:59 +0000 (0:00:00.538) 0:01:08.182 ********* 2026-03-17 16:34:59,780 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-distributor-http is running." } 2026-03-17 16:34:59,786 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gateway-http"] ******************* 2026-03-17 16:34:59,786 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:34:59 +0000 (0:00:00.023) 0:01:08.206 ********* 2026-03-17 16:35:00,312 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:00,318 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace] *** 2026-03-17 16:35:00,318 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:00 +0000 (0:00:00.532) 0:01:08.738 ********* 2026-03-17 16:35:00,341 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-gateway-http is running." } 2026-03-17 16:35:00,347 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gossip-ring"] ******************** 2026-03-17 16:35:00,347 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:00 +0000 (0:00:00.029) 0:01:08.768 ********* 2026-03-17 16:35:00,904 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:00,909 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace] *** 2026-03-17 16:35:00,909 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:00 +0000 (0:00:00.562) 0:01:09.330 ********* 2026-03-17 16:35:00,933 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-gossip-ring is running." } 2026-03-17 16:35:00,938 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-grpc"] ************* 2026-03-17 16:35:00,939 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:00 +0000 (0:00:00.029) 0:01:09.359 ********* 2026-03-17 16:35:01,487 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:01,492 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace] *** 2026-03-17 16:35:01,492 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:01 +0000 (0:00:00.553) 0:01:09.913 ********* 2026-03-17 16:35:01,517 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-index-gateway-grpc is running." } 2026-03-17 16:35:01,522 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-http"] ************* 2026-03-17 16:35:01,522 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:01 +0000 (0:00:00.029) 0:01:09.943 ********* 2026-03-17 16:35:02,098 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:02,103 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace] *** 2026-03-17 16:35:02,103 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:02 +0000 (0:00:00.580) 0:01:10.523 ********* 2026-03-17 16:35:02,121 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-index-gateway-http is running." } 2026-03-17 16:35:02,126 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-grpc"] ****************** 2026-03-17 16:35:02,126 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:02 +0000 (0:00:00.022) 0:01:10.546 ********* 2026-03-17 16:35:02,678 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:02,685 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace] *** 2026-03-17 16:35:02,685 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:02 +0000 (0:00:00.559) 0:01:11.106 ********* 2026-03-17 16:35:02,705 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-ingester-grpc is running." } 2026-03-17 16:35:02,710 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-http"] ****************** 2026-03-17 16:35:02,710 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:02 +0000 (0:00:00.025) 0:01:11.131 ********* 2026-03-17 16:35:03,241 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:03,247 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace] *** 2026-03-17 16:35:03,247 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:03 +0000 (0:00:00.536) 0:01:11.667 ********* 2026-03-17 16:35:03,267 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-ingester-http is running." } 2026-03-17 16:35:03,272 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-grpc"] ******************* 2026-03-17 16:35:03,273 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:03 +0000 (0:00:00.025) 0:01:11.693 ********* 2026-03-17 16:35:03,786 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:03,792 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace] *** 2026-03-17 16:35:03,792 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:03 +0000 (0:00:00.519) 0:01:12.213 ********* 2026-03-17 16:35:03,812 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-querier-grpc is running." } 2026-03-17 16:35:03,817 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-http"] ******************* 2026-03-17 16:35:03,817 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:03 +0000 (0:00:00.025) 0:01:12.238 ********* 2026-03-17 16:35:04,405 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:04,411 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace] *** 2026-03-17 16:35:04,411 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:04 +0000 (0:00:00.593) 0:01:12.831 ********* 2026-03-17 16:35:04,432 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-querier-http is running." } 2026-03-17 16:35:04,437 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-grpc"] ************ 2026-03-17 16:35:04,437 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:04 +0000 (0:00:00.026) 0:01:12.858 ********* 2026-03-17 16:35:05,018 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:05,024 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace] *** 2026-03-17 16:35:05,024 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:05 +0000 (0:00:00.587) 0:01:13.445 ********* 2026-03-17 16:35:05,041 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-query-frontend-grpc is running." } 2026-03-17 16:35:05,047 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-http"] ************ 2026-03-17 16:35:05,047 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:05 +0000 (0:00:00.022) 0:01:13.467 ********* 2026-03-17 16:35:05,532 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:05,537 p=37681 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace] *** 2026-03-17 16:35:05,537 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:05 +0000 (0:00:00.490) 0:01:13.958 ********* 2026-03-17 16:35:05,555 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-query-frontend-http is running." } 2026-03-17 16:35:05,560 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "openstack-logging"] *************************** 2026-03-17 16:35:05,560 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:05 +0000 (0:00:00.022) 0:01:13.980 ********* 2026-03-17 16:35:06,039 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:06,044 p=37681 u=zuul n=ansible | TASK [common : TEST Verify openstack-logging service is running in openshift-logging namespace] *** 2026-03-17 16:35:06,044 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:06 +0000 (0:00:00.484) 0:01:14.465 ********* 2026-03-17 16:35:06,061 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service openstack-logging is running." } 2026-03-17 16:35:06,065 p=37681 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 16:35:06,065 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:06 +0000 (0:00:00.020) 0:01:14.485 ********* 2026-03-17 16:35:06,078 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:06,082 p=37681 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 16:35:06,082 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:06 +0000 (0:00:00.017) 0:01:14.503 ********* 2026-03-17 16:35:06,704 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:06,714 p=37681 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 16:35:06,714 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:06 +0000 (0:00:00.631) 0:01:15.134 ********* 2026-03-17 16:35:06,741 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/manifest_tests.yml for controller => (item={'name': 'loki-operator', 'expected_number': 2}) 2026-03-17 16:35:06,763 p=37681 u=zuul n=ansible | TASK [common : TEST Get loki-operator 2 packagemanifest] *********************** 2026-03-17 16:35:06,763 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:06 +0000 (0:00:00.049) 0:01:15.183 ********* 2026-03-17 16:35:06,841 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "Expected 2 and found 2\n" } 2026-03-17 16:35:06,846 p=37681 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 16:35:06,846 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:06 +0000 (0:00:00.082) 0:01:15.266 ********* 2026-03-17 16:35:06,868 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:06,873 p=37681 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 16:35:06,873 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:06 +0000 (0:00:00.026) 0:01:15.293 ********* 2026-03-17 16:35:06,889 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:06,894 p=37681 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 16:35:06,894 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:06 +0000 (0:00:00.021) 0:01:15.314 ********* 2026-03-17 16:35:06,916 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:06,931 p=37681 u=zuul n=ansible | PLAY [Verify logging pods are running in openstack] **************************** 2026-03-17 16:35:06,938 p=37681 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 16:35:06,939 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:06 +0000 (0:00:00.044) 0:01:15.359 ********* 2026-03-17 16:35:06,966 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstackclient) 2026-03-17 16:35:06,971 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:35:06,971 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:06 +0000 (0:00:00.032) 0:01:15.392 ********* 2026-03-17 16:35:07,615 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:07,620 p=37681 u=zuul n=ansible | TASK [common : TEST Check openstackclient pod is Running in openstack namespace] *** 2026-03-17 16:35:07,620 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:07 +0000 (0:00:00.648) 0:01:16.040 ********* 2026-03-17 16:35:08,164 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:08,168 p=37681 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 16:35:08,168 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.548) 0:01:16.589 ********* 2026-03-17 16:35:08,186 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:08,190 p=37681 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 16:35:08,190 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.021) 0:01:16.610 ********* 2026-03-17 16:35:08,206 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:08,209 p=37681 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 16:35:08,210 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.019) 0:01:16.630 ********* 2026-03-17 16:35:08,225 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:08,229 p=37681 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 16:35:08,229 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.019) 0:01:16.649 ********* 2026-03-17 16:35:08,245 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:08,248 p=37681 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 16:35:08,248 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.019) 0:01:16.669 ********* 2026-03-17 16:35:08,265 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:08,268 p=37681 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 16:35:08,268 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.019) 0:01:16.688 ********* 2026-03-17 16:35:08,283 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:08,287 p=37681 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 16:35:08,287 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.019) 0:01:16.708 ********* 2026-03-17 16:35:08,304 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:08,307 p=37681 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 16:35:08,307 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.019) 0:01:16.727 ********* 2026-03-17 16:35:08,324 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:08,329 p=37681 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 16:35:08,329 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.022) 0:01:16.750 ********* 2026-03-17 16:35:08,347 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:08,351 p=37681 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 16:35:08,351 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.021) 0:01:16.772 ********* 2026-03-17 16:35:08,369 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:08,387 p=37681 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-operators-redhat] *********** 2026-03-17 16:35:08,397 p=37681 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 16:35:08,397 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.045) 0:01:16.818 ********* 2026-03-17 16:35:08,426 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=loki-operator-controller-manager) 2026-03-17 16:35:08,436 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:35:08,436 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:08 +0000 (0:00:00.039) 0:01:16.857 ********* 2026-03-17 16:35:09,064 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:09,070 p=37681 u=zuul n=ansible | TASK [common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace] *** 2026-03-17 16:35:09,071 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.634) 0:01:17.491 ********* 2026-03-17 16:35:09,672 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:09,679 p=37681 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 16:35:09,679 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.608) 0:01:18.100 ********* 2026-03-17 16:35:09,698 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:09,704 p=37681 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 16:35:09,704 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.024) 0:01:18.124 ********* 2026-03-17 16:35:09,721 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:09,726 p=37681 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 16:35:09,726 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.022) 0:01:18.146 ********* 2026-03-17 16:35:09,744 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:09,749 p=37681 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 16:35:09,749 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.022) 0:01:18.169 ********* 2026-03-17 16:35:09,766 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:09,772 p=37681 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 16:35:09,772 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.022) 0:01:18.192 ********* 2026-03-17 16:35:09,790 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:09,794 p=37681 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 16:35:09,794 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.021) 0:01:18.214 ********* 2026-03-17 16:35:09,810 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:09,814 p=37681 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 16:35:09,814 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.020) 0:01:18.235 ********* 2026-03-17 16:35:09,830 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:09,834 p=37681 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 16:35:09,834 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.019) 0:01:18.254 ********* 2026-03-17 16:35:09,850 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:09,853 p=37681 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 16:35:09,853 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.019) 0:01:18.274 ********* 2026-03-17 16:35:09,869 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:09,872 p=37681 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 16:35:09,873 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.019) 0:01:18.293 ********* 2026-03-17 16:35:09,888 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:09,900 p=37681 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-logging] ******************** 2026-03-17 16:35:09,907 p=37681 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 16:35:09,907 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.034) 0:01:18.328 ********* 2026-03-17 16:35:09,974 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=cluster-logging-operator) 2026-03-17 16:35:09,976 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-compactor) 2026-03-17 16:35:09,978 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-distributor) 2026-03-17 16:35:09,979 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-index-gateway) 2026-03-17 16:35:09,981 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-ingester) 2026-03-17 16:35:09,983 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-querier) 2026-03-17 16:35:09,984 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-query-frontend) 2026-03-17 16:35:09,986 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=collector) 2026-03-17 16:35:09,992 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:35:09,992 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:09 +0000 (0:00:00.084) 0:01:18.412 ********* 2026-03-17 16:35:10,532 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:10,537 p=37681 u=zuul n=ansible | TASK [common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace] *** 2026-03-17 16:35:10,537 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:10 +0000 (0:00:00.545) 0:01:18.958 ********* 2026-03-17 16:35:11,004 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:11,009 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:35:11,010 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:11 +0000 (0:00:00.472) 0:01:19.430 ********* 2026-03-17 16:35:11,560 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:11,565 p=37681 u=zuul n=ansible | TASK [common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace] *** 2026-03-17 16:35:11,565 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:11 +0000 (0:00:00.555) 0:01:19.985 ********* 2026-03-17 16:35:12,150 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:12,155 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:35:12,155 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:12 +0000 (0:00:00.590) 0:01:20.576 ********* 2026-03-17 16:35:12,699 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:12,704 p=37681 u=zuul n=ansible | TASK [common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace] *** 2026-03-17 16:35:12,705 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:12 +0000 (0:00:00.549) 0:01:21.125 ********* 2026-03-17 16:35:13,211 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:13,216 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:35:13,216 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:13 +0000 (0:00:00.511) 0:01:21.636 ********* 2026-03-17 16:35:13,797 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:13,803 p=37681 u=zuul n=ansible | TASK [common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace] *** 2026-03-17 16:35:13,804 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:13 +0000 (0:00:00.587) 0:01:22.224 ********* 2026-03-17 16:35:14,349 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:14,354 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:35:14,354 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:14 +0000 (0:00:00.550) 0:01:22.775 ********* 2026-03-17 16:35:15,743 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:15,750 p=37681 u=zuul n=ansible | TASK [common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace] *** 2026-03-17 16:35:15,750 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:15 +0000 (0:00:01.396) 0:01:24.171 ********* 2026-03-17 16:35:16,844 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:16,853 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:35:16,853 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:16 +0000 (0:00:01.102) 0:01:25.273 ********* 2026-03-17 16:35:17,364 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:17,369 p=37681 u=zuul n=ansible | TASK [common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace] *** 2026-03-17 16:35:17,369 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:17 +0000 (0:00:00.516) 0:01:25.790 ********* 2026-03-17 16:35:17,895 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:17,901 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:35:17,902 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:17 +0000 (0:00:00.532) 0:01:26.322 ********* 2026-03-17 16:35:18,498 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:18,504 p=37681 u=zuul n=ansible | TASK [common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace] *** 2026-03-17 16:35:18,504 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:18 +0000 (0:00:00.602) 0:01:26.924 ********* 2026-03-17 16:35:19,089 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:19,093 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:35:19,094 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:19 +0000 (0:00:00.589) 0:01:27.514 ********* 2026-03-17 16:35:19,630 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:19,637 p=37681 u=zuul n=ansible | TASK [common : TEST Check collector pod is Running in openshift-logging namespace] *** 2026-03-17 16:35:19,637 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:19 +0000 (0:00:00.543) 0:01:28.057 ********* 2026-03-17 16:35:20,281 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:20,286 p=37681 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 16:35:20,286 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.649) 0:01:28.706 ********* 2026-03-17 16:35:20,303 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:20,307 p=37681 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 16:35:20,307 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.021) 0:01:28.728 ********* 2026-03-17 16:35:20,324 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:20,328 p=37681 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 16:35:20,328 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.020) 0:01:28.748 ********* 2026-03-17 16:35:20,345 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:20,349 p=37681 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 16:35:20,349 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.020) 0:01:28.769 ********* 2026-03-17 16:35:20,365 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:20,369 p=37681 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 16:35:20,369 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.020) 0:01:28.790 ********* 2026-03-17 16:35:20,389 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:20,393 p=37681 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 16:35:20,393 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.023) 0:01:28.813 ********* 2026-03-17 16:35:20,408 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:20,412 p=37681 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 16:35:20,412 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.019) 0:01:28.832 ********* 2026-03-17 16:35:20,429 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:20,432 p=37681 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 16:35:20,432 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.019) 0:01:28.852 ********* 2026-03-17 16:35:20,447 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:20,451 p=37681 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 16:35:20,451 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.018) 0:01:28.871 ********* 2026-03-17 16:35:20,465 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:20,469 p=37681 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 16:35:20,469 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.018) 0:01:28.889 ********* 2026-03-17 16:35:20,485 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:20,501 p=37681 u=zuul n=ansible | PLAY [Verify logging pods are running in minio-dev] **************************** 2026-03-17 16:35:20,511 p=37681 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 16:35:20,512 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.042) 0:01:28.932 ********* 2026-03-17 16:35:20,540 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=minio) 2026-03-17 16:35:20,547 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 16:35:20,547 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:20 +0000 (0:00:00.035) 0:01:28.967 ********* 2026-03-17 16:35:21,096 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:21,101 p=37681 u=zuul n=ansible | TASK [common : TEST Check minio pod is Running in minio-dev namespace] ********* 2026-03-17 16:35:21,101 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.554) 0:01:29.521 ********* 2026-03-17 16:35:21,664 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:21,668 p=37681 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 16:35:21,668 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.567) 0:01:30.089 ********* 2026-03-17 16:35:21,686 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:21,691 p=37681 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 16:35:21,691 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.022) 0:01:30.111 ********* 2026-03-17 16:35:21,709 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:21,713 p=37681 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 16:35:21,713 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.022) 0:01:30.134 ********* 2026-03-17 16:35:21,731 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:21,735 p=37681 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 16:35:21,735 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.021) 0:01:30.155 ********* 2026-03-17 16:35:21,754 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:21,758 p=37681 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 16:35:21,758 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.022) 0:01:30.178 ********* 2026-03-17 16:35:21,776 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:21,781 p=37681 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 16:35:21,781 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.022) 0:01:30.201 ********* 2026-03-17 16:35:21,798 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:21,803 p=37681 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 16:35:21,803 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.022) 0:01:30.223 ********* 2026-03-17 16:35:21,820 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:21,823 p=37681 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 16:35:21,823 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.020) 0:01:30.244 ********* 2026-03-17 16:35:21,845 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:21,849 p=37681 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 16:35:21,849 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.025) 0:01:30.269 ********* 2026-03-17 16:35:21,871 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:21,875 p=37681 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 16:35:21,876 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.026) 0:01:30.296 ********* 2026-03-17 16:35:21,893 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:21,909 p=37681 u=zuul n=ansible | PLAY [Verify logging pods have complete status in openstack] ******************* 2026-03-17 16:35:21,921 p=37681 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 16:35:21,921 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:21 +0000 (0:00:00.045) 0:01:30.342 ********* 2026-03-17 16:35:22,035 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=bootstrap-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,038 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-network-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,041 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-os-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,044 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-certs-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,046 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-os-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,049 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=libvirt-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,050 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,052 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=neutron-metadata-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,054 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ovn-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,056 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=reboot-os-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,058 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=run-os-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,060 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ssh-known-hosts-edpm-deployment) 2026-03-17 16:35:22,063 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,065 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=validate-network-edpm-deployment-openstack-edpm-ipam) 2026-03-17 16:35:22,071 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:22,071 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:22 +0000 (0:00:00.149) 0:01:30.492 ********* 2026-03-17 16:35:22,848 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:22,856 p=37681 u=zuul n=ansible | TASK [common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:22,856 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:22 +0000 (0:00:00.784) 0:01:31.276 ********* 2026-03-17 16:35:23,430 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:23,435 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:23,435 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:23 +0000 (0:00:00.579) 0:01:31.855 ********* 2026-03-17 16:35:24,039 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:24,045 p=37681 u=zuul n=ansible | TASK [common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:24,045 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:24 +0000 (0:00:00.609) 0:01:32.465 ********* 2026-03-17 16:35:24,582 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:24,587 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:24,587 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:24 +0000 (0:00:00.541) 0:01:33.007 ********* 2026-03-17 16:35:25,195 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:25,200 p=37681 u=zuul n=ansible | TASK [common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:25,200 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:25 +0000 (0:00:00.613) 0:01:33.620 ********* 2026-03-17 16:35:25,743 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:25,749 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:25,749 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:25 +0000 (0:00:00.549) 0:01:34.170 ********* 2026-03-17 16:35:26,399 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:26,404 p=37681 u=zuul n=ansible | TASK [common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:26,404 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:26 +0000 (0:00:00.654) 0:01:34.824 ********* 2026-03-17 16:35:27,020 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:27,027 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:27,027 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:27 +0000 (0:00:00.623) 0:01:35.447 ********* 2026-03-17 16:35:27,599 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:27,605 p=37681 u=zuul n=ansible | TASK [common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:27,605 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:27 +0000 (0:00:00.578) 0:01:36.026 ********* 2026-03-17 16:35:28,162 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:28,166 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:28,167 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:28 +0000 (0:00:00.561) 0:01:36.587 ********* 2026-03-17 16:35:28,778 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:28,783 p=37681 u=zuul n=ansible | TASK [common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:28,783 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:28 +0000 (0:00:00.616) 0:01:37.204 ********* 2026-03-17 16:35:29,670 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:29,676 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:29,676 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:29 +0000 (0:00:00.893) 0:01:38.097 ********* 2026-03-17 16:35:30,299 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:30,305 p=37681 u=zuul n=ansible | TASK [common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:30,305 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:30 +0000 (0:00:00.628) 0:01:38.726 ********* 2026-03-17 16:35:30,839 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:30,845 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:30,845 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:30 +0000 (0:00:00.539) 0:01:39.265 ********* 2026-03-17 16:35:31,490 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:31,495 p=37681 u=zuul n=ansible | TASK [common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:31,495 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:31 +0000 (0:00:00.649) 0:01:39.915 ********* 2026-03-17 16:35:32,044 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:32,050 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:32,051 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:32 +0000 (0:00:00.555) 0:01:40.471 ********* 2026-03-17 16:35:32,697 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:32,701 p=37681 u=zuul n=ansible | TASK [common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:32,701 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:32 +0000 (0:00:00.650) 0:01:41.122 ********* 2026-03-17 16:35:33,300 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:33,307 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:33,308 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:33 +0000 (0:00:00.606) 0:01:41.728 ********* 2026-03-17 16:35:33,976 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:33,982 p=37681 u=zuul n=ansible | TASK [common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:33,982 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:33 +0000 (0:00:00.674) 0:01:42.402 ********* 2026-03-17 16:35:34,548 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:34,553 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:34,553 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:34 +0000 (0:00:00.570) 0:01:42.973 ********* 2026-03-17 16:35:35,093 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:35,097 p=37681 u=zuul n=ansible | TASK [common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:35,097 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:35 +0000 (0:00:00.544) 0:01:43.518 ********* 2026-03-17 16:35:35,718 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:35,725 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:35,725 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:35 +0000 (0:00:00.627) 0:01:44.145 ********* 2026-03-17 16:35:36,332 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:36,338 p=37681 u=zuul n=ansible | TASK [common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace] *** 2026-03-17 16:35:36,338 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:36 +0000 (0:00:00.613) 0:01:44.759 ********* 2026-03-17 16:35:36,898 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:36,904 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:36,904 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:36 +0000 (0:00:00.566) 0:01:45.325 ********* 2026-03-17 16:35:37,488 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:37,492 p=37681 u=zuul n=ansible | TASK [common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:37,492 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:37 +0000 (0:00:00.588) 0:01:45.913 ********* 2026-03-17 16:35:38,009 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:38,013 p=37681 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 16:35:38,013 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:38 +0000 (0:00:00.520) 0:01:46.433 ********* 2026-03-17 16:35:38,541 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:38,545 p=37681 u=zuul n=ansible | TASK [common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 16:35:38,545 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:38 +0000 (0:00:00.532) 0:01:46.966 ********* 2026-03-17 16:35:39,007 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:39,011 p=37681 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 16:35:39,011 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.465) 0:01:47.431 ********* 2026-03-17 16:35:39,027 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,031 p=37681 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 16:35:39,031 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.020) 0:01:47.451 ********* 2026-03-17 16:35:39,048 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,053 p=37681 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 16:35:39,053 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.021) 0:01:47.473 ********* 2026-03-17 16:35:39,069 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,073 p=37681 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 16:35:39,073 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.020) 0:01:47.493 ********* 2026-03-17 16:35:39,090 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,093 p=37681 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 16:35:39,094 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.020) 0:01:47.514 ********* 2026-03-17 16:35:39,109 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,112 p=37681 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 16:35:39,112 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.018) 0:01:47.533 ********* 2026-03-17 16:35:39,129 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,134 p=37681 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 16:35:39,134 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.021) 0:01:47.554 ********* 2026-03-17 16:35:39,150 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,154 p=37681 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 16:35:39,155 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.020) 0:01:47.575 ********* 2026-03-17 16:35:39,170 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,174 p=37681 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 16:35:39,174 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.019) 0:01:47.594 ********* 2026-03-17 16:35:39,190 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,194 p=37681 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 16:35:39,195 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.020) 0:01:47.615 ********* 2026-03-17 16:35:39,211 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,233 p=37681 u=zuul n=ansible | PLAY [Verify the crds exist] *************************************************** 2026-03-17 16:35:39,246 p=37681 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 16:35:39,246 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.051) 0:01:47.666 ********* 2026-03-17 16:35:39,262 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,265 p=37681 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 16:35:39,265 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.019) 0:01:47.686 ********* 2026-03-17 16:35:39,283 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,287 p=37681 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 16:35:39,287 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.021) 0:01:47.707 ********* 2026-03-17 16:35:39,305 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,309 p=37681 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 16:35:39,309 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.022) 0:01:47.730 ********* 2026-03-17 16:35:39,327 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:39,331 p=37681 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 16:35:39,331 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.021) 0:01:47.752 ********* 2026-03-17 16:35:39,371 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-internal) 2026-03-17 16:35:39,373 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-metadata-internal) 2026-03-17 16:35:39,374 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-novncproxy-cell1-public) 2026-03-17 16:35:39,375 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-public) 2026-03-17 16:35:39,380 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "nova-internal"] ******************************* 2026-03-17 16:35:39,380 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.049) 0:01:47.801 ********* 2026-03-17 16:35:39,926 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:39,931 p=37681 u=zuul n=ansible | TASK [common : TEST Verify nova-internal service is running in openstack namespace] *** 2026-03-17 16:35:39,931 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.550) 0:01:48.352 ********* 2026-03-17 16:35:39,951 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-internal is running." } 2026-03-17 16:35:39,956 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "nova-metadata-internal"] ********************** 2026-03-17 16:35:39,956 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:39 +0000 (0:00:00.024) 0:01:48.376 ********* 2026-03-17 16:35:40,559 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:40,564 p=37681 u=zuul n=ansible | TASK [common : TEST Verify nova-metadata-internal service is running in openstack namespace] *** 2026-03-17 16:35:40,565 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:40 +0000 (0:00:00.608) 0:01:48.985 ********* 2026-03-17 16:35:40,585 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-metadata-internal is running." } 2026-03-17 16:35:40,591 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "nova-novncproxy-cell1-public"] **************** 2026-03-17 16:35:40,591 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:40 +0000 (0:00:00.026) 0:01:49.011 ********* 2026-03-17 16:35:41,165 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:41,170 p=37681 u=zuul n=ansible | TASK [common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace] *** 2026-03-17 16:35:41,170 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:41 +0000 (0:00:00.579) 0:01:49.591 ********* 2026-03-17 16:35:41,192 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-novncproxy-cell1-public is running." } 2026-03-17 16:35:41,197 p=37681 u=zuul n=ansible | TASK [common : Verify Service - "nova-public"] ********************************* 2026-03-17 16:35:41,197 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:41 +0000 (0:00:00.026) 0:01:49.618 ********* 2026-03-17 16:35:41,782 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:41,787 p=37681 u=zuul n=ansible | TASK [common : TEST Verify nova-public service is running in openstack namespace] *** 2026-03-17 16:35:41,787 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:41 +0000 (0:00:00.590) 0:01:50.208 ********* 2026-03-17 16:35:41,811 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-public is running." } 2026-03-17 16:35:41,815 p=37681 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 16:35:41,815 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:41 +0000 (0:00:00.027) 0:01:50.236 ********* 2026-03-17 16:35:41,839 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:41,844 p=37681 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 16:35:41,844 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:41 +0000 (0:00:00.028) 0:01:50.264 ********* 2026-03-17 16:35:41,867 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:41,871 p=37681 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 16:35:41,871 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:41 +0000 (0:00:00.026) 0:01:50.291 ********* 2026-03-17 16:35:41,893 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:41,896 p=37681 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 16:35:41,897 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:41 +0000 (0:00:00.025) 0:01:50.317 ********* 2026-03-17 16:35:41,946 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=alertingrules.loki.grafana.com) 2026-03-17 16:35:41,948 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=lokistacks.loki.grafana.com) 2026-03-17 16:35:41,949 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=recordingrules.loki.grafana.com) 2026-03-17 16:35:41,951 p=37681 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=rulerconfigs.loki.grafana.com) 2026-03-17 16:35:41,956 p=37681 u=zuul n=ansible | TASK [common : Verify CRD "alertingrules.loki.grafana.com"] ******************** 2026-03-17 16:35:41,956 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:41 +0000 (0:00:00.059) 0:01:50.376 ********* 2026-03-17 16:35:42,493 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:42,497 p=37681 u=zuul n=ansible | TASK [common : TEST Verify CRD alertingrules.loki.grafana.com is found] ******** 2026-03-17 16:35:42,498 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:42 +0000 (0:00:00.541) 0:01:50.918 ********* 2026-03-17 16:35:42,517 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD alertingrules.loki.grafana.com is found." } 2026-03-17 16:35:42,521 p=37681 u=zuul n=ansible | TASK [common : Verify CRD "lokistacks.loki.grafana.com"] *********************** 2026-03-17 16:35:42,521 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:42 +0000 (0:00:00.023) 0:01:50.942 ********* 2026-03-17 16:35:43,046 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:43,051 p=37681 u=zuul n=ansible | TASK [common : TEST Verify CRD lokistacks.loki.grafana.com is found] *********** 2026-03-17 16:35:43,051 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:43 +0000 (0:00:00.529) 0:01:51.472 ********* 2026-03-17 16:35:43,069 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD lokistacks.loki.grafana.com is found." } 2026-03-17 16:35:43,074 p=37681 u=zuul n=ansible | TASK [common : Verify CRD "recordingrules.loki.grafana.com"] ******************* 2026-03-17 16:35:43,074 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:43 +0000 (0:00:00.022) 0:01:51.494 ********* 2026-03-17 16:35:43,604 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:43,609 p=37681 u=zuul n=ansible | TASK [common : TEST Verify CRD recordingrules.loki.grafana.com is found] ******* 2026-03-17 16:35:43,609 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:43 +0000 (0:00:00.535) 0:01:52.030 ********* 2026-03-17 16:35:43,627 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD recordingrules.loki.grafana.com is found." } 2026-03-17 16:35:43,631 p=37681 u=zuul n=ansible | TASK [common : Verify CRD "rulerconfigs.loki.grafana.com"] ********************* 2026-03-17 16:35:43,631 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:43 +0000 (0:00:00.021) 0:01:52.051 ********* 2026-03-17 16:35:44,160 p=37681 u=zuul n=ansible | ok: [controller] 2026-03-17 16:35:44,166 p=37681 u=zuul n=ansible | TASK [common : TEST Verify CRD rulerconfigs.loki.grafana.com is found] ********* 2026-03-17 16:35:44,166 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:44 +0000 (0:00:00.534) 0:01:52.586 ********* 2026-03-17 16:35:44,192 p=37681 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD rulerconfigs.loki.grafana.com is found." } 2026-03-17 16:35:44,197 p=37681 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 16:35:44,197 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:44 +0000 (0:00:00.030) 0:01:52.617 ********* 2026-03-17 16:35:44,220 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:44,223 p=37681 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 16:35:44,224 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:44 +0000 (0:00:00.026) 0:01:52.644 ********* 2026-03-17 16:35:44,245 p=37681 u=zuul n=ansible | skipping: [controller] 2026-03-17 16:35:44,260 p=37681 u=zuul n=ansible | PLAY RECAP ********************************************************************* 2026-03-17 16:35:44,260 p=37681 u=zuul n=ansible | compute-0 : ok=19 changed=0 unreachable=0 failed=0 skipped=24 rescued=0 ignored=0 2026-03-17 16:35:44,260 p=37681 u=zuul n=ansible | controller : ok=219 changed=0 unreachable=0 failed=0 skipped=63 rescued=0 ignored=0 2026-03-17 16:35:44,332 p=37681 u=zuul n=ansible | Tuesday 17 March 2026 16:35:44 +0000 (0:00:00.108) 0:01:52.753 ********* 2026-03-17 16:35:44,332 p=37681 u=zuul n=ansible | =============================================================================== 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'internal']" -------------- 3.47s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'public']" ------------- 3.27s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'internal']" -------------- 3.25s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'internal']" --------- 3.14s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'internal']" ------ 3.01s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'public']" ---------------- 3.00s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'public']" --------- 2.98s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'public']" ---------- 2.96s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'public']" ----------- 2.93s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'public']" ---------------- 2.84s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'internal']" ----------- 2.84s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'public']" ----------- 2.81s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'internal']" --------- 2.77s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'internal']" ------- 2.76s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'public']" -------- 2.70s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'internal']" -------- 2.68s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute RHOSO-XXX ----------- 2.43s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 2.30s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 1.74s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 1.40s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace --- 1.10s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.91s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX --- 0.89s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.89s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.81s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.78s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf" -------- 0.77s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.69s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.67s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.65s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.65s 2026-03-17 16:35:44,333 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.65s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : TEST Check collector pod is Running in openshift-logging namespace --- 0.65s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.65s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.64s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.63s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.63s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.63s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.63s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.62s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.62s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace --- 0.61s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Verify subscription "loki-operator" ---------------------------- 0.61s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace --- 0.61s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Verify Service - "nova-metadata-internal" ---------------------- 0.61s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get the openshift-logging project ------------------------------ 0.61s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.61s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.60s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-http" ----------------- 0.60s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-http" ------------------- 0.59s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace --- 0.59s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Verify Service - "nova-public" --------------------------------- 0.59s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace --- 0.59s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace --- 0.59s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.59s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.59s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-grpc" ------------ 0.59s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get the openshift project -------------------------------------- 0.58s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-grpc" ----------------- 0.58s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-http" ------------- 0.58s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Verify Service - "nova-novncproxy-cell1-public" ---------------- 0.58s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.58s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.58s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Get the openstack-operators project ---------------------------- 0.57s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.57s 2026-03-17 16:35:44,334 p=37681 u=zuul n=ansible | common : Verify Service - "cluster-logging-operator-metrics" ------------ 0.57s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check minio pod is Running in minio-dev namespace -------- 0.57s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace --- 0.57s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-gossip-ring" -------------------- 0.56s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.56s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-grpc" ------------------ 0.56s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.56s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.56s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-grpc" ------------- 0.55s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-grpc" --------------- 0.55s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify Service - "nova-internal" ------------------------------- 0.55s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace --- 0.55s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.55s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check openstackclient pod is Running in openstack namespace --- 0.55s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.54s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.54s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.54s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify CRD "alertingrules.loki.grafana.com" -------------------- 0.54s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.54s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-http" --------------- 0.54s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-http" ------------------ 0.54s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify CRD "recordingrules.loki.grafana.com" ------------------- 0.54s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify CRD "rulerconfigs.loki.grafana.com" --------------------- 0.53s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.53s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace --- 0.53s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-gateway-http" ------------------- 0.53s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify CRD "lokistacks.loki.grafana.com" ----------------------- 0.53s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Get the openshift-openstack-infra project ---------------------- 0.53s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.52s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-grpc" ------------------- 0.52s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.52s 2026-03-17 16:35:44,335 p=37681 u=zuul n=ansible | common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace --- 0.51s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-http" ------------ 0.49s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Verify Service - "openstack-logging" --------------------------- 0.48s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace --- 0.47s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.47s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.18s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.15s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.13s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.11s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute RHOSO-XXX ----------- 0.08s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.08s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : TEST Get loki-operator 2 packagemanifest ---------------------- 0.08s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : TEST Verify node_exporter container status -------------------- 0.08s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | telemetry_logging : Verify journal entries ------------------------------ 0.08s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists --- 0.07s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.07s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : TEST Verify ceilometer_agent_compute container status --------- 0.06s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.06s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.06s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.05s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.05s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.05s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.05s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX --- 0.05s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.05s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.05s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : TEST Check that nova internal endpoint exists ----------------- 0.04s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : TEST Check that keystone internal endpoint exists ------------- 0.04s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.04s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.04s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.04s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-17 16:35:44,336 p=37681 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.04s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Check that nova public endpoint exists ------------------- 0.04s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.04s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Check that placement public endpoint exists -------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Check that swift internal endpoint exists ---------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Check that glance internal endpoint exists --------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Check that glance public endpoint exists ----------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Check that placement internal endpoint exists ------------ 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Check that neutron public endpoint exists ---------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Check that barbican internal endpoint exists ------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Verify CRD rulerconfigs.loki.grafana.com is found -------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Check that keystone public endpoint exists --------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Check that barbican public endpoint exists --------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace --- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace --- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Verify openshift-openstack-infra project exists ---------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Verify openshift-logging project exists ------------------ 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Check that cinderv3 public endpoint exists --------------- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : TEST Verify nova-public service is running in openstack namespace --- 0.03s 2026-03-17 16:35:44,337 p=37681 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace --- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace --- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace --- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Check that cinderv3 internal endpoint exists ------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify nova-metadata-internal service is running in openstack namespace --- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace --- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace --- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace --- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify nova-internal service is running in openstack namespace --- 0.02s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify openshift project exists -------------------------- 0.02s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify CRD alertingrules.loki.grafana.com is found ------- 0.02s 2026-03-17 16:35:44,338 p=37681 u=zuul n=ansible | common : TEST Verify openstack-operators project exists ---------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace --- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : TEST Check that neutron internal endpoint exists -------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace --- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace --- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : TEST Verify CRD lokistacks.loki.grafana.com is found ---------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : TEST Verify CRD recordingrules.loki.grafana.com is found ------ 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : TEST Check that swift public endpoint exists ------------------ 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 16:35:44,339 p=37681 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : TEST Verify openstack-logging service is running in openshift-logging namespace --- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-17 16:35:44,340 p=37681 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s