2026-03-08 01:37:15,183 p=39346 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace 2026-03-08 01:37:15,183 p=39346 u=zuul n=ansible | PLAY [Verify logging journalctl identifiers] *********************************** 2026-03-08 01:37:15,191 p=39346 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-08 01:37:15,192 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:15 +0000 (0:00:00.011) 0:00:00.011 ********** 2026-03-08 01:37:17,683 p=39346 u=zuul n=ansible | ok: [compute-0] 2026-03-08 01:37:17,719 p=39346 u=zuul n=ansible | TASK [telemetry_logging : Verify journal entries] ****************************** 2026-03-08 01:37:17,719 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:17 +0000 (0:00:02.527) 0:00:02.538 ********** 2026-03-08 01:37:17,787 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=ceilometer_agent_compute) 2026-03-08 01:37:17,790 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=nova_compute) 2026-03-08 01:37:17,802 p=39346 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX] *** 2026-03-08 01:37:17,803 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:17 +0000 (0:00:00.083) 0:00:02.622 ********** 2026-03-08 01:37:19,171 p=39346 u=zuul n=ansible | ok: [compute-0] 2026-03-08 01:37:19,207 p=39346 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX] *** 2026-03-08 01:37:19,208 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:19 +0000 (0:00:01.405) 0:00:04.027 ********** 2026-03-08 01:37:19,269 p=39346 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed!" } 2026-03-08 01:37:19,283 p=39346 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute RHOSO-XXX] ************* 2026-03-08 01:37:19,283 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:19 +0000 (0:00:00.075) 0:00:04.102 ********** 2026-03-08 01:37:21,886 p=39346 u=zuul n=ansible | ok: [compute-0] 2026-03-08 01:37:21,943 p=39346 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute RHOSO-XXX] ************* 2026-03-08 01:37:21,943 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:21 +0000 (0:00:02.660) 0:00:06.762 ********** 2026-03-08 01:37:22,025 p=39346 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed!" } 2026-03-08 01:37:22,047 p=39346 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-08 01:37:22,047 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:22 +0000 (0:00:00.104) 0:00:06.866 ********** 2026-03-08 01:37:22,064 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:22,075 p=39346 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-08 01:37:22,076 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:22 +0000 (0:00:00.028) 0:00:06.895 ********** 2026-03-08 01:37:22,092 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:22,105 p=39346 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-08 01:37:22,106 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:22 +0000 (0:00:00.029) 0:00:06.925 ********** 2026-03-08 01:37:22,124 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:22,138 p=39346 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-08 01:37:22,138 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:22 +0000 (0:00:00.032) 0:00:06.957 ********** 2026-03-08 01:37:22,155 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:22,167 p=39346 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-08 01:37:22,167 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:22 +0000 (0:00:00.028) 0:00:06.986 ********** 2026-03-08 01:37:22,183 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:22,194 p=39346 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-08 01:37:22,194 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:22 +0000 (0:00:00.026) 0:00:07.013 ********** 2026-03-08 01:37:22,228 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/file_tests.yml for compute-0 => (item=/etc/rsyslog.d/10-telemetry.conf) 2026-03-08 01:37:22,244 p=39346 u=zuul n=ansible | TASK [common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf"] ******** 2026-03-08 01:37:22,244 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:22 +0000 (0:00:00.049) 0:00:07.063 ********** 2026-03-08 01:37:23,110 p=39346 u=zuul n=ansible | ok: [compute-0] 2026-03-08 01:37:23,123 p=39346 u=zuul n=ansible | TASK [common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists] *** 2026-03-08 01:37:23,124 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:23 +0000 (0:00:00.879) 0:00:07.943 ********** 2026-03-08 01:37:23,181 p=39346 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed" } 2026-03-08 01:37:23,194 p=39346 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-08 01:37:23,194 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:23 +0000 (0:00:00.070) 0:00:08.013 ********** 2026-03-08 01:37:23,211 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:23,223 p=39346 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-08 01:37:23,223 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:23 +0000 (0:00:00.029) 0:00:08.042 ********** 2026-03-08 01:37:23,244 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:23,257 p=39346 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-08 01:37:23,258 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:23 +0000 (0:00:00.034) 0:00:08.077 ********** 2026-03-08 01:37:23,278 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:23,292 p=39346 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-08 01:37:23,292 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:23 +0000 (0:00:00.034) 0:00:08.111 ********** 2026-03-08 01:37:23,308 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:23,316 p=39346 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-08 01:37:23,316 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:23 +0000 (0:00:00.024) 0:00:08.135 ********** 2026-03-08 01:37:23,337 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:23,369 p=39346 u=zuul n=ansible | PLAY [Run container tests which require root on compute nodes] ***************** 2026-03-08 01:37:23,377 p=39346 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-08 01:37:23,377 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:23 +0000 (0:00:00.061) 0:00:08.197 ********** 2026-03-08 01:37:25,466 p=39346 u=zuul n=ansible | ok: [compute-0] 2026-03-08 01:37:25,509 p=39346 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-08 01:37:25,509 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:02.131) 0:00:10.328 ********** 2026-03-08 01:37:25,544 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:25,556 p=39346 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-08 01:37:25,556 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:00.046) 0:00:10.375 ********** 2026-03-08 01:37:25,588 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:25,599 p=39346 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-08 01:37:25,600 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:00.043) 0:00:10.419 ********** 2026-03-08 01:37:25,622 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:25,634 p=39346 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-08 01:37:25,634 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:00.034) 0:00:10.453 ********** 2026-03-08 01:37:25,656 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:25,667 p=39346 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-08 01:37:25,667 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:00.033) 0:00:10.486 ********** 2026-03-08 01:37:25,688 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:25,699 p=39346 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-08 01:37:25,699 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:00.031) 0:00:10.518 ********** 2026-03-08 01:37:25,725 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:25,733 p=39346 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-08 01:37:25,733 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:00.034) 0:00:10.552 ********** 2026-03-08 01:37:25,753 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:25,763 p=39346 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-08 01:37:25,763 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:00.030) 0:00:10.583 ********** 2026-03-08 01:37:25,785 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:25,793 p=39346 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-08 01:37:25,793 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:00.029) 0:00:10.612 ********** 2026-03-08 01:37:25,814 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:25,822 p=39346 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-08 01:37:25,822 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:00.029) 0:00:10.641 ********** 2026-03-08 01:37:25,841 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:25,851 p=39346 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-08 01:37:25,851 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:00.028) 0:00:10.670 ********** 2026-03-08 01:37:25,887 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=ceilometer_agent_compute) 2026-03-08 01:37:25,890 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=node_exporter) 2026-03-08 01:37:25,898 p=39346 u=zuul n=ansible | TASK [common : Get container status] ******************************************* 2026-03-08 01:37:25,899 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:25 +0000 (0:00:00.047) 0:00:10.718 ********** 2026-03-08 01:37:26,602 p=39346 u=zuul n=ansible | ok: [compute-0] 2026-03-08 01:37:26,622 p=39346 u=zuul n=ansible | TASK [common : Show the container name and status] ***************************** 2026-03-08 01:37:26,622 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:26 +0000 (0:00:00.723) 0:00:11.441 ********** 2026-03-08 01:37:26,643 p=39346 u=zuul n=ansible | ok: [compute-0] => { "container_status.stdout": "ceilometer_agent_compute Up 7 minutes (healthy)" } 2026-03-08 01:37:26,663 p=39346 u=zuul n=ansible | TASK [common : Show the containers] ******************************************** 2026-03-08 01:37:26,664 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:26 +0000 (0:00:00.041) 0:00:11.483 ********** 2026-03-08 01:37:26,695 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:26,709 p=39346 u=zuul n=ansible | TASK [common : Show the output of container list] ****************************** 2026-03-08 01:37:26,709 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:26 +0000 (0:00:00.045) 0:00:11.528 ********** 2026-03-08 01:37:26,739 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:26,751 p=39346 u=zuul n=ansible | TASK [common : TEST Verify ceilometer_agent_compute container status] ********** 2026-03-08 01:37:26,751 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:26 +0000 (0:00:00.041) 0:00:11.570 ********** 2026-03-08 01:37:26,790 p=39346 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "Container 'ceilometer_agent_compute' is in 'healthy' status." } 2026-03-08 01:37:26,798 p=39346 u=zuul n=ansible | TASK [common : Get container status] ******************************************* 2026-03-08 01:37:26,798 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:26 +0000 (0:00:00.047) 0:00:11.617 ********** 2026-03-08 01:37:27,397 p=39346 u=zuul n=ansible | ok: [compute-0] 2026-03-08 01:37:27,407 p=39346 u=zuul n=ansible | TASK [common : Show the container name and status] ***************************** 2026-03-08 01:37:27,407 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:27 +0000 (0:00:00.608) 0:00:12.226 ********** 2026-03-08 01:37:27,431 p=39346 u=zuul n=ansible | ok: [compute-0] => { "container_status.stdout": "node_exporter Up 7 minutes (healthy)" } 2026-03-08 01:37:27,440 p=39346 u=zuul n=ansible | TASK [common : Show the containers] ******************************************** 2026-03-08 01:37:27,440 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:27 +0000 (0:00:00.032) 0:00:12.259 ********** 2026-03-08 01:37:27,479 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:27,487 p=39346 u=zuul n=ansible | TASK [common : Show the output of container list] ****************************** 2026-03-08 01:37:27,487 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:27 +0000 (0:00:00.047) 0:00:12.306 ********** 2026-03-08 01:37:27,519 p=39346 u=zuul n=ansible | skipping: [compute-0] 2026-03-08 01:37:27,529 p=39346 u=zuul n=ansible | TASK [common : TEST Verify node_exporter container status] ********************* 2026-03-08 01:37:27,529 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:27 +0000 (0:00:00.041) 0:00:12.348 ********** 2026-03-08 01:37:27,571 p=39346 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "Container 'node_exporter' is in 'healthy' status." } 2026-03-08 01:37:27,609 p=39346 u=zuul n=ansible | PLAY [Verify logging projects, endpoints, credentials, nodes, pods, services, manifests and subscriptions] *** 2026-03-08 01:37:27,618 p=39346 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-08 01:37:27,619 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:27 +0000 (0:00:00.089) 0:00:12.438 ********** 2026-03-08 01:37:27,650 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-operator-controller-manager) 2026-03-08 01:37:27,653 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstack-operator-controller-manager) 2026-03-08 01:37:27,659 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:37:27,659 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:27 +0000 (0:00:00.040) 0:00:12.478 ********** 2026-03-08 01:37:28,568 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:28,574 p=39346 u=zuul n=ansible | TASK [common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace] *** 2026-03-08 01:37:28,574 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:28 +0000 (0:00:00.914) 0:00:13.393 ********** 2026-03-08 01:37:29,055 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:29,060 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:37:29,060 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:29 +0000 (0:00:00.486) 0:00:13.879 ********** 2026-03-08 01:37:29,571 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:29,576 p=39346 u=zuul n=ansible | TASK [common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace] *** 2026-03-08 01:37:29,577 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:29 +0000 (0:00:00.516) 0:00:14.396 ********** 2026-03-08 01:37:30,108 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:30,112 p=39346 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-08 01:37:30,112 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:30 +0000 (0:00:00.535) 0:00:14.931 ********** 2026-03-08 01:37:30,141 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/subscription_tests.yml for controller => (item=loki-operator) 2026-03-08 01:37:30,150 p=39346 u=zuul n=ansible | TASK [common : Verify subscription "loki-operator"] **************************** 2026-03-08 01:37:30,150 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:30 +0000 (0:00:00.037) 0:00:14.969 ********** 2026-03-08 01:37:30,718 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:30,723 p=39346 u=zuul n=ansible | TASK [common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace] *** 2026-03-08 01:37:30,723 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:30 +0000 (0:00:00.573) 0:00:15.542 ********** 2026-03-08 01:37:30,745 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "subscription loki-operator is found." } 2026-03-08 01:37:30,749 p=39346 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-08 01:37:30,749 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:30 +0000 (0:00:00.025) 0:00:15.568 ********** 2026-03-08 01:37:30,847 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'public']) 2026-03-08 01:37:30,850 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'internal']) 2026-03-08 01:37:30,853 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'public']) 2026-03-08 01:37:30,855 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'internal']) 2026-03-08 01:37:30,858 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'public']) 2026-03-08 01:37:30,861 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'internal']) 2026-03-08 01:37:30,864 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'public']) 2026-03-08 01:37:30,867 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'internal']) 2026-03-08 01:37:30,869 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'public']) 2026-03-08 01:37:30,872 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'internal']) 2026-03-08 01:37:30,875 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'public']) 2026-03-08 01:37:30,877 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'internal']) 2026-03-08 01:37:30,878 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'public']) 2026-03-08 01:37:30,880 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'internal']) 2026-03-08 01:37:30,882 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'public']) 2026-03-08 01:37:30,883 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'internal']) 2026-03-08 01:37:30,893 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'public']"] **************** 2026-03-08 01:37:30,893 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:30 +0000 (0:00:00.144) 0:00:15.712 ********** 2026-03-08 01:37:33,572 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:33,583 p=39346 u=zuul n=ansible | TASK [common : TEST Check that nova public endpoint exists] ******************** 2026-03-08 01:37:33,584 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:33 +0000 (0:00:02.690) 0:00:18.403 ********** 2026-03-08 01:37:33,601 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint nova is found." } 2026-03-08 01:37:33,612 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'internal']"] ************** 2026-03-08 01:37:33,612 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:33 +0000 (0:00:00.028) 0:00:18.431 ********** 2026-03-08 01:37:36,294 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:36,300 p=39346 u=zuul n=ansible | TASK [common : TEST Check that nova internal endpoint exists] ****************** 2026-03-08 01:37:36,300 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:36 +0000 (0:00:02.687) 0:00:21.119 ********** 2026-03-08 01:37:36,326 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint nova is found." } 2026-03-08 01:37:36,331 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'public']"] ********* 2026-03-08 01:37:36,331 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:36 +0000 (0:00:00.031) 0:00:21.150 ********** 2026-03-08 01:37:38,952 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:38,962 p=39346 u=zuul n=ansible | TASK [common : TEST Check that placement public endpoint exists] *************** 2026-03-08 01:37:38,962 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:38 +0000 (0:00:02.631) 0:00:23.781 ********** 2026-03-08 01:37:38,996 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint placement is found." } 2026-03-08 01:37:39,002 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'internal']"] ******* 2026-03-08 01:37:39,002 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:39 +0000 (0:00:00.039) 0:00:23.821 ********** 2026-03-08 01:37:41,587 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:41,597 p=39346 u=zuul n=ansible | TASK [common : TEST Check that placement internal endpoint exists] ************* 2026-03-08 01:37:41,598 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:41 +0000 (0:00:02.595) 0:00:26.417 ********** 2026-03-08 01:37:41,630 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint placement is found." } 2026-03-08 01:37:41,640 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'public']"] ********** 2026-03-08 01:37:41,641 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:41 +0000 (0:00:00.043) 0:00:26.460 ********** 2026-03-08 01:37:44,251 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:44,261 p=39346 u=zuul n=ansible | TASK [common : TEST Check that swift public endpoint exists] ******************* 2026-03-08 01:37:44,262 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:44 +0000 (0:00:02.620) 0:00:29.081 ********** 2026-03-08 01:37:44,292 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint swift is found." } 2026-03-08 01:37:44,299 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'internal']"] ******** 2026-03-08 01:37:44,299 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:44 +0000 (0:00:00.037) 0:00:29.118 ********** 2026-03-08 01:37:46,906 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:46,919 p=39346 u=zuul n=ansible | TASK [common : TEST Check that swift internal endpoint exists] ***************** 2026-03-08 01:37:46,920 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:46 +0000 (0:00:02.620) 0:00:31.739 ********** 2026-03-08 01:37:46,944 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint swift is found." } 2026-03-08 01:37:46,952 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'public']"] *********** 2026-03-08 01:37:46,952 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:46 +0000 (0:00:00.032) 0:00:31.771 ********** 2026-03-08 01:37:49,354 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:49,365 p=39346 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 public endpoint exists] **************** 2026-03-08 01:37:49,365 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:49 +0000 (0:00:02.413) 0:00:34.184 ********** 2026-03-08 01:37:49,399 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint cinderv3 is found." } 2026-03-08 01:37:49,405 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'internal']"] ********* 2026-03-08 01:37:49,405 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:49 +0000 (0:00:00.039) 0:00:34.224 ********** 2026-03-08 01:37:51,800 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:51,810 p=39346 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 internal endpoint exists] ************** 2026-03-08 01:37:51,810 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:51 +0000 (0:00:02.405) 0:00:36.629 ********** 2026-03-08 01:37:51,843 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint cinderv3 is found." } 2026-03-08 01:37:51,852 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'public']"] ******** 2026-03-08 01:37:51,852 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:51 +0000 (0:00:00.041) 0:00:36.671 ********** 2026-03-08 01:37:54,458 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:54,470 p=39346 u=zuul n=ansible | TASK [common : TEST Check that barbican public endpoint exists] **************** 2026-03-08 01:37:54,470 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:54 +0000 (0:00:02.617) 0:00:39.289 ********** 2026-03-08 01:37:54,504 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint barbican is found." } 2026-03-08 01:37:54,515 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'internal']"] ****** 2026-03-08 01:37:54,515 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:54 +0000 (0:00:00.044) 0:00:39.334 ********** 2026-03-08 01:37:57,114 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:57,122 p=39346 u=zuul n=ansible | TASK [common : TEST Check that barbican internal endpoint exists] ************** 2026-03-08 01:37:57,122 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:57 +0000 (0:00:02.606) 0:00:41.941 ********** 2026-03-08 01:37:57,145 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint barbican is found." } 2026-03-08 01:37:57,153 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'public']"] *********** 2026-03-08 01:37:57,153 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:57 +0000 (0:00:00.030) 0:00:41.972 ********** 2026-03-08 01:37:59,502 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:37:59,513 p=39346 u=zuul n=ansible | TASK [common : TEST Check that keystone public endpoint exists] **************** 2026-03-08 01:37:59,514 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:59 +0000 (0:00:02.360) 0:00:44.333 ********** 2026-03-08 01:37:59,547 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint keystone is found." } 2026-03-08 01:37:59,558 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'internal']"] ********* 2026-03-08 01:37:59,559 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:37:59 +0000 (0:00:00.044) 0:00:44.378 ********** 2026-03-08 01:38:02,383 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:02,391 p=39346 u=zuul n=ansible | TASK [common : TEST Check that keystone internal endpoint exists] ************** 2026-03-08 01:38:02,391 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:02 +0000 (0:00:02.832) 0:00:47.210 ********** 2026-03-08 01:38:02,428 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint keystone is found." } 2026-03-08 01:38:02,434 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'public']"] **************** 2026-03-08 01:38:02,434 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:02 +0000 (0:00:00.042) 0:00:47.253 ********** 2026-03-08 01:38:05,230 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:05,236 p=39346 u=zuul n=ansible | TASK [common : TEST Check that glance public endpoint exists] ****************** 2026-03-08 01:38:05,236 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:05 +0000 (0:00:02.801) 0:00:50.055 ********** 2026-03-08 01:38:05,253 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint glance is found." } 2026-03-08 01:38:05,258 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'internal']"] ************** 2026-03-08 01:38:05,259 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:05 +0000 (0:00:00.022) 0:00:50.078 ********** 2026-03-08 01:38:07,736 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:07,742 p=39346 u=zuul n=ansible | TASK [common : TEST Check that glance internal endpoint exists] **************** 2026-03-08 01:38:07,742 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:07 +0000 (0:00:02.483) 0:00:52.561 ********** 2026-03-08 01:38:07,765 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint glance is found." } 2026-03-08 01:38:07,770 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'public']"] ************* 2026-03-08 01:38:07,770 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:07 +0000 (0:00:00.028) 0:00:52.589 ********** 2026-03-08 01:38:10,147 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:10,153 p=39346 u=zuul n=ansible | TASK [common : TEST Check that neutron public endpoint exists] ***************** 2026-03-08 01:38:10,153 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:10 +0000 (0:00:02.382) 0:00:54.972 ********** 2026-03-08 01:38:10,170 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint neutron is found." } 2026-03-08 01:38:10,175 p=39346 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'internal']"] *********** 2026-03-08 01:38:10,176 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:10 +0000 (0:00:00.022) 0:00:54.995 ********** 2026-03-08 01:38:12,758 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:12,770 p=39346 u=zuul n=ansible | TASK [common : TEST Check that neutron internal endpoint exists] *************** 2026-03-08 01:38:12,770 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:12 +0000 (0:00:02.594) 0:00:57.589 ********** 2026-03-08 01:38:12,806 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint neutron is found." } 2026-03-08 01:38:12,812 p=39346 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-08 01:38:12,813 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:12 +0000 (0:00:00.042) 0:00:57.632 ********** 2026-03-08 01:38:12,864 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-openstack-infra) 2026-03-08 01:38:12,868 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift) 2026-03-08 01:38:12,871 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openstack-operators) 2026-03-08 01:38:12,874 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-logging) 2026-03-08 01:38:12,905 p=39346 u=zuul n=ansible | TASK [common : Get the openshift-openstack-infra project] ********************** 2026-03-08 01:38:12,906 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:12 +0000 (0:00:00.092) 0:00:57.725 ********** 2026-03-08 01:38:13,430 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:13,435 p=39346 u=zuul n=ansible | TASK [common : TEST Verify openshift-openstack-infra project exists] *********** 2026-03-08 01:38:13,436 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:13 +0000 (0:00:00.529) 0:00:58.255 ********** 2026-03-08 01:38:13,453 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift-openstack-infra is found." } 2026-03-08 01:38:13,458 p=39346 u=zuul n=ansible | TASK [common : Get the openshift project] ************************************** 2026-03-08 01:38:13,458 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:13 +0000 (0:00:00.022) 0:00:58.277 ********** 2026-03-08 01:38:13,934 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:13,939 p=39346 u=zuul n=ansible | TASK [common : TEST Verify openshift project exists] *************************** 2026-03-08 01:38:13,940 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:13 +0000 (0:00:00.481) 0:00:58.759 ********** 2026-03-08 01:38:13,961 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift is found." } 2026-03-08 01:38:13,965 p=39346 u=zuul n=ansible | TASK [common : Get the openstack-operators project] **************************** 2026-03-08 01:38:13,965 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:13 +0000 (0:00:00.025) 0:00:58.785 ********** 2026-03-08 01:38:14,562 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:14,568 p=39346 u=zuul n=ansible | TASK [common : TEST Verify openstack-operators project exists] ***************** 2026-03-08 01:38:14,568 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:14 +0000 (0:00:00.602) 0:00:59.387 ********** 2026-03-08 01:38:14,588 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openstack-operators is found." } 2026-03-08 01:38:14,593 p=39346 u=zuul n=ansible | TASK [common : Get the openshift-logging project] ****************************** 2026-03-08 01:38:14,593 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:14 +0000 (0:00:00.025) 0:00:59.413 ********** 2026-03-08 01:38:15,205 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:15,211 p=39346 u=zuul n=ansible | TASK [common : TEST Verify openshift-logging project exists] ******************* 2026-03-08 01:38:15,211 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:15 +0000 (0:00:00.617) 0:01:00.030 ********** 2026-03-08 01:38:15,238 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift-logging is found." } 2026-03-08 01:38:15,243 p=39346 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-08 01:38:15,243 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:15 +0000 (0:00:00.031) 0:01:00.062 ********** 2026-03-08 01:38:15,359 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=cluster-logging-operator-metrics) 2026-03-08 01:38:15,361 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-grpc) 2026-03-08 01:38:15,363 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-http) 2026-03-08 01:38:15,364 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-grpc) 2026-03-08 01:38:15,366 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-http) 2026-03-08 01:38:15,368 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gateway-http) 2026-03-08 01:38:15,370 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gossip-ring) 2026-03-08 01:38:15,371 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-grpc) 2026-03-08 01:38:15,373 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-http) 2026-03-08 01:38:15,375 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-grpc) 2026-03-08 01:38:15,377 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-http) 2026-03-08 01:38:15,378 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-grpc) 2026-03-08 01:38:15,380 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-http) 2026-03-08 01:38:15,382 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-grpc) 2026-03-08 01:38:15,383 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-http) 2026-03-08 01:38:15,385 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=openstack-logging) 2026-03-08 01:38:15,420 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "cluster-logging-operator-metrics"] ************ 2026-03-08 01:38:15,420 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:15 +0000 (0:00:00.176) 0:01:00.239 ********** 2026-03-08 01:38:16,026 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:16,032 p=39346 u=zuul n=ansible | TASK [common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace] *** 2026-03-08 01:38:16,032 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:16 +0000 (0:00:00.611) 0:01:00.851 ********** 2026-03-08 01:38:16,049 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service cluster-logging-operator-metrics is running." } 2026-03-08 01:38:16,053 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-grpc"] ***************** 2026-03-08 01:38:16,053 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:16 +0000 (0:00:00.021) 0:01:00.872 ********** 2026-03-08 01:38:16,521 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:16,527 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace] *** 2026-03-08 01:38:16,527 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:16 +0000 (0:00:00.473) 0:01:01.346 ********** 2026-03-08 01:38:16,543 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-compactor-grpc is running." } 2026-03-08 01:38:16,549 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-http"] ***************** 2026-03-08 01:38:16,549 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:16 +0000 (0:00:00.021) 0:01:01.368 ********** 2026-03-08 01:38:17,050 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:17,055 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace] *** 2026-03-08 01:38:17,055 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:17 +0000 (0:00:00.506) 0:01:01.874 ********** 2026-03-08 01:38:17,081 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-compactor-http is running." } 2026-03-08 01:38:17,087 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-grpc"] *************** 2026-03-08 01:38:17,087 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:17 +0000 (0:00:00.032) 0:01:01.907 ********** 2026-03-08 01:38:17,623 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:17,628 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace] *** 2026-03-08 01:38:17,629 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:17 +0000 (0:00:00.541) 0:01:02.448 ********** 2026-03-08 01:38:17,646 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-distributor-grpc is running." } 2026-03-08 01:38:17,651 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-http"] *************** 2026-03-08 01:38:17,651 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:17 +0000 (0:00:00.022) 0:01:02.470 ********** 2026-03-08 01:38:18,184 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:18,190 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace] *** 2026-03-08 01:38:18,190 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:18 +0000 (0:00:00.538) 0:01:03.009 ********** 2026-03-08 01:38:18,207 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-distributor-http is running." } 2026-03-08 01:38:18,212 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gateway-http"] ******************* 2026-03-08 01:38:18,213 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:18 +0000 (0:00:00.022) 0:01:03.032 ********** 2026-03-08 01:38:18,655 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:18,660 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace] *** 2026-03-08 01:38:18,660 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:18 +0000 (0:00:00.447) 0:01:03.479 ********** 2026-03-08 01:38:18,675 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-gateway-http is running." } 2026-03-08 01:38:18,680 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gossip-ring"] ******************** 2026-03-08 01:38:18,680 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:18 +0000 (0:00:00.020) 0:01:03.499 ********** 2026-03-08 01:38:19,130 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:19,135 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace] *** 2026-03-08 01:38:19,135 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:19 +0000 (0:00:00.455) 0:01:03.954 ********** 2026-03-08 01:38:19,149 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-gossip-ring is running." } 2026-03-08 01:38:19,154 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-grpc"] ************* 2026-03-08 01:38:19,154 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:19 +0000 (0:00:00.018) 0:01:03.973 ********** 2026-03-08 01:38:19,587 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:19,592 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace] *** 2026-03-08 01:38:19,592 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:19 +0000 (0:00:00.438) 0:01:04.412 ********** 2026-03-08 01:38:19,611 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-index-gateway-grpc is running." } 2026-03-08 01:38:19,617 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-http"] ************* 2026-03-08 01:38:19,617 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:19 +0000 (0:00:00.024) 0:01:04.436 ********** 2026-03-08 01:38:20,053 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:20,059 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace] *** 2026-03-08 01:38:20,059 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:20 +0000 (0:00:00.441) 0:01:04.878 ********** 2026-03-08 01:38:20,073 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-index-gateway-http is running." } 2026-03-08 01:38:20,078 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-grpc"] ****************** 2026-03-08 01:38:20,078 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:20 +0000 (0:00:00.018) 0:01:04.897 ********** 2026-03-08 01:38:20,568 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:20,573 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace] *** 2026-03-08 01:38:20,573 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:20 +0000 (0:00:00.495) 0:01:05.392 ********** 2026-03-08 01:38:20,588 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-ingester-grpc is running." } 2026-03-08 01:38:20,593 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-http"] ****************** 2026-03-08 01:38:20,593 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:20 +0000 (0:00:00.019) 0:01:05.412 ********** 2026-03-08 01:38:21,143 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:21,149 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace] *** 2026-03-08 01:38:21,149 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:21 +0000 (0:00:00.555) 0:01:05.968 ********** 2026-03-08 01:38:21,174 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-ingester-http is running." } 2026-03-08 01:38:21,180 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-grpc"] ******************* 2026-03-08 01:38:21,180 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:21 +0000 (0:00:00.031) 0:01:05.999 ********** 2026-03-08 01:38:21,733 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:21,739 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace] *** 2026-03-08 01:38:21,739 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:21 +0000 (0:00:00.558) 0:01:06.558 ********** 2026-03-08 01:38:21,757 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-querier-grpc is running." } 2026-03-08 01:38:21,762 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-http"] ******************* 2026-03-08 01:38:21,762 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:21 +0000 (0:00:00.023) 0:01:06.581 ********** 2026-03-08 01:38:22,323 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:22,331 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace] *** 2026-03-08 01:38:22,331 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:22 +0000 (0:00:00.568) 0:01:07.150 ********** 2026-03-08 01:38:22,353 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-querier-http is running." } 2026-03-08 01:38:22,359 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-grpc"] ************ 2026-03-08 01:38:22,359 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:22 +0000 (0:00:00.028) 0:01:07.178 ********** 2026-03-08 01:38:22,893 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:22,898 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace] *** 2026-03-08 01:38:22,898 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:22 +0000 (0:00:00.538) 0:01:07.717 ********** 2026-03-08 01:38:22,918 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-query-frontend-grpc is running." } 2026-03-08 01:38:22,922 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-http"] ************ 2026-03-08 01:38:22,922 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:22 +0000 (0:00:00.024) 0:01:07.741 ********** 2026-03-08 01:38:23,400 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:23,405 p=39346 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace] *** 2026-03-08 01:38:23,405 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:23 +0000 (0:00:00.482) 0:01:08.224 ********** 2026-03-08 01:38:23,422 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-query-frontend-http is running." } 2026-03-08 01:38:23,426 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "openstack-logging"] *************************** 2026-03-08 01:38:23,426 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:23 +0000 (0:00:00.020) 0:01:08.245 ********** 2026-03-08 01:38:23,871 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:23,876 p=39346 u=zuul n=ansible | TASK [common : TEST Verify openstack-logging service is running in openshift-logging namespace] *** 2026-03-08 01:38:23,876 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:23 +0000 (0:00:00.449) 0:01:08.695 ********** 2026-03-08 01:38:23,893 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service openstack-logging is running." } 2026-03-08 01:38:23,897 p=39346 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-08 01:38:23,897 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:23 +0000 (0:00:00.021) 0:01:08.716 ********** 2026-03-08 01:38:23,911 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:23,916 p=39346 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-08 01:38:23,916 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:23 +0000 (0:00:00.018) 0:01:08.735 ********** 2026-03-08 01:38:24,598 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:24,604 p=39346 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-08 01:38:24,604 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:24 +0000 (0:00:00.687) 0:01:09.423 ********** 2026-03-08 01:38:24,630 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/manifest_tests.yml for controller => (item={'name': 'loki-operator', 'expected_number': 2}) 2026-03-08 01:38:24,647 p=39346 u=zuul n=ansible | TASK [common : TEST Get loki-operator 2 packagemanifest] *********************** 2026-03-08 01:38:24,648 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:24 +0000 (0:00:00.043) 0:01:09.467 ********** 2026-03-08 01:38:24,701 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "Expected 2 and found 2\n" } 2026-03-08 01:38:24,705 p=39346 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-08 01:38:24,705 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:24 +0000 (0:00:00.057) 0:01:09.524 ********** 2026-03-08 01:38:24,724 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:24,727 p=39346 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-08 01:38:24,727 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:24 +0000 (0:00:00.022) 0:01:09.546 ********** 2026-03-08 01:38:24,744 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:24,748 p=39346 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-08 01:38:24,748 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:24 +0000 (0:00:00.020) 0:01:09.567 ********** 2026-03-08 01:38:24,765 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:24,779 p=39346 u=zuul n=ansible | PLAY [Verify logging pods are running in openstack] **************************** 2026-03-08 01:38:24,786 p=39346 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-08 01:38:24,786 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:24 +0000 (0:00:00.038) 0:01:09.606 ********** 2026-03-08 01:38:24,816 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstackclient) 2026-03-08 01:38:24,821 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:38:24,821 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:24 +0000 (0:00:00.034) 0:01:09.640 ********** 2026-03-08 01:38:25,437 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:25,441 p=39346 u=zuul n=ansible | TASK [common : TEST Check openstackclient pod is Running in openstack namespace] *** 2026-03-08 01:38:25,441 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:25 +0000 (0:00:00.620) 0:01:10.260 ********** 2026-03-08 01:38:26,019 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:26,023 p=39346 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-08 01:38:26,023 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.581) 0:01:10.842 ********** 2026-03-08 01:38:26,045 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:26,048 p=39346 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-08 01:38:26,048 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.025) 0:01:10.867 ********** 2026-03-08 01:38:26,068 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:26,071 p=39346 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-08 01:38:26,071 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.022) 0:01:10.890 ********** 2026-03-08 01:38:26,090 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:26,093 p=39346 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-08 01:38:26,093 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.022) 0:01:10.912 ********** 2026-03-08 01:38:26,112 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:26,115 p=39346 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-08 01:38:26,115 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.022) 0:01:10.935 ********** 2026-03-08 01:38:26,133 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:26,136 p=39346 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-08 01:38:26,136 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.020) 0:01:10.955 ********** 2026-03-08 01:38:26,151 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:26,155 p=39346 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-08 01:38:26,155 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.019) 0:01:10.974 ********** 2026-03-08 01:38:26,171 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:26,174 p=39346 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-08 01:38:26,174 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.019) 0:01:10.993 ********** 2026-03-08 01:38:26,190 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:26,193 p=39346 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-08 01:38:26,194 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.019) 0:01:11.013 ********** 2026-03-08 01:38:26,209 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:26,212 p=39346 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-08 01:38:26,212 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.018) 0:01:11.032 ********** 2026-03-08 01:38:26,227 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:26,238 p=39346 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-operators-redhat] *********** 2026-03-08 01:38:26,246 p=39346 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-08 01:38:26,246 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.033) 0:01:11.065 ********** 2026-03-08 01:38:26,272 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=loki-operator-controller-manager) 2026-03-08 01:38:26,277 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:38:26,277 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.031) 0:01:11.097 ********** 2026-03-08 01:38:26,785 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:26,790 p=39346 u=zuul n=ansible | TASK [common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace] *** 2026-03-08 01:38:26,791 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:26 +0000 (0:00:00.513) 0:01:11.610 ********** 2026-03-08 01:38:27,377 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:27,381 p=39346 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-08 01:38:27,381 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.590) 0:01:12.200 ********** 2026-03-08 01:38:27,398 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:27,402 p=39346 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-08 01:38:27,402 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.021) 0:01:12.221 ********** 2026-03-08 01:38:27,419 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:27,422 p=39346 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-08 01:38:27,422 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.019) 0:01:12.241 ********** 2026-03-08 01:38:27,438 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:27,441 p=39346 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-08 01:38:27,441 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.019) 0:01:12.260 ********** 2026-03-08 01:38:27,457 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:27,461 p=39346 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-08 01:38:27,461 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.019) 0:01:12.280 ********** 2026-03-08 01:38:27,482 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:27,486 p=39346 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-08 01:38:27,486 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.025) 0:01:12.305 ********** 2026-03-08 01:38:27,505 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:27,510 p=39346 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-08 01:38:27,510 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.024) 0:01:12.329 ********** 2026-03-08 01:38:27,527 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:27,532 p=39346 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-08 01:38:27,532 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.021) 0:01:12.351 ********** 2026-03-08 01:38:27,548 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:27,552 p=39346 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-08 01:38:27,552 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.020) 0:01:12.371 ********** 2026-03-08 01:38:27,569 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:27,574 p=39346 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-08 01:38:27,574 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.021) 0:01:12.393 ********** 2026-03-08 01:38:27,590 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:27,608 p=39346 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-logging] ******************** 2026-03-08 01:38:27,620 p=39346 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-08 01:38:27,620 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.046) 0:01:12.439 ********** 2026-03-08 01:38:27,694 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=cluster-logging-operator) 2026-03-08 01:38:27,696 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-compactor) 2026-03-08 01:38:27,698 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-distributor) 2026-03-08 01:38:27,699 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-index-gateway) 2026-03-08 01:38:27,701 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-ingester) 2026-03-08 01:38:27,702 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-querier) 2026-03-08 01:38:27,704 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-query-frontend) 2026-03-08 01:38:27,706 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=collector) 2026-03-08 01:38:27,711 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:38:27,711 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:27 +0000 (0:00:00.090) 0:01:12.530 ********** 2026-03-08 01:38:28,229 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:28,237 p=39346 u=zuul n=ansible | TASK [common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace] *** 2026-03-08 01:38:28,237 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:28 +0000 (0:00:00.526) 0:01:13.056 ********** 2026-03-08 01:38:28,792 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:28,796 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:38:28,797 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:28 +0000 (0:00:00.559) 0:01:13.616 ********** 2026-03-08 01:38:29,320 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:29,324 p=39346 u=zuul n=ansible | TASK [common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace] *** 2026-03-08 01:38:29,324 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:29 +0000 (0:00:00.527) 0:01:14.143 ********** 2026-03-08 01:38:29,848 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:29,853 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:38:29,853 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:29 +0000 (0:00:00.529) 0:01:14.672 ********** 2026-03-08 01:38:30,418 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:30,424 p=39346 u=zuul n=ansible | TASK [common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace] *** 2026-03-08 01:38:30,424 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:30 +0000 (0:00:00.570) 0:01:15.243 ********** 2026-03-08 01:38:30,991 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:30,996 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:38:30,996 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:30 +0000 (0:00:00.571) 0:01:15.815 ********** 2026-03-08 01:38:31,569 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:31,576 p=39346 u=zuul n=ansible | TASK [common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace] *** 2026-03-08 01:38:31,576 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:31 +0000 (0:00:00.580) 0:01:16.395 ********** 2026-03-08 01:38:32,092 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:32,099 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:38:32,099 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:32 +0000 (0:00:00.522) 0:01:16.918 ********** 2026-03-08 01:38:32,699 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:32,704 p=39346 u=zuul n=ansible | TASK [common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace] *** 2026-03-08 01:38:32,704 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:32 +0000 (0:00:00.604) 0:01:17.523 ********** 2026-03-08 01:38:33,270 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:33,277 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:38:33,277 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:33 +0000 (0:00:00.573) 0:01:18.096 ********** 2026-03-08 01:38:33,959 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:33,965 p=39346 u=zuul n=ansible | TASK [common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace] *** 2026-03-08 01:38:33,965 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:33 +0000 (0:00:00.687) 0:01:18.784 ********** 2026-03-08 01:38:34,581 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:34,585 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:38:34,586 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:34 +0000 (0:00:00.620) 0:01:19.405 ********** 2026-03-08 01:38:35,180 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:35,184 p=39346 u=zuul n=ansible | TASK [common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace] *** 2026-03-08 01:38:35,184 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:35 +0000 (0:00:00.598) 0:01:20.003 ********** 2026-03-08 01:38:35,673 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:35,678 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:38:35,678 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:35 +0000 (0:00:00.493) 0:01:20.497 ********** 2026-03-08 01:38:36,202 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:36,207 p=39346 u=zuul n=ansible | TASK [common : TEST Check collector pod is Running in openshift-logging namespace] *** 2026-03-08 01:38:36,207 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.529) 0:01:21.026 ********** 2026-03-08 01:38:36,744 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:36,748 p=39346 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-08 01:38:36,748 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.540) 0:01:21.567 ********** 2026-03-08 01:38:36,766 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:36,769 p=39346 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-08 01:38:36,770 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.021) 0:01:21.589 ********** 2026-03-08 01:38:36,785 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:36,789 p=39346 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-08 01:38:36,789 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.019) 0:01:21.608 ********** 2026-03-08 01:38:36,804 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:36,807 p=39346 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-08 01:38:36,807 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.018) 0:01:21.627 ********** 2026-03-08 01:38:36,823 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:36,827 p=39346 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-08 01:38:36,827 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.019) 0:01:21.646 ********** 2026-03-08 01:38:36,845 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:36,848 p=39346 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-08 01:38:36,848 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.021) 0:01:21.667 ********** 2026-03-08 01:38:36,864 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:36,867 p=39346 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-08 01:38:36,867 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.019) 0:01:21.687 ********** 2026-03-08 01:38:36,884 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:36,887 p=39346 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-08 01:38:36,887 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.019) 0:01:21.706 ********** 2026-03-08 01:38:36,903 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:36,907 p=39346 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-08 01:38:36,907 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.020) 0:01:21.726 ********** 2026-03-08 01:38:36,922 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:36,926 p=39346 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-08 01:38:36,926 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.018) 0:01:21.745 ********** 2026-03-08 01:38:36,942 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:36,954 p=39346 u=zuul n=ansible | PLAY [Verify logging pods are running in minio-dev] **************************** 2026-03-08 01:38:36,963 p=39346 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-08 01:38:36,963 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:36 +0000 (0:00:00.037) 0:01:21.782 ********** 2026-03-08 01:38:36,996 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=minio) 2026-03-08 01:38:37,002 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-08 01:38:37,002 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:37 +0000 (0:00:00.038) 0:01:21.821 ********** 2026-03-08 01:38:37,592 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:37,597 p=39346 u=zuul n=ansible | TASK [common : TEST Check minio pod is Running in minio-dev namespace] ********* 2026-03-08 01:38:37,597 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:37 +0000 (0:00:00.595) 0:01:22.416 ********** 2026-03-08 01:38:38,102 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:38,105 p=39346 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-08 01:38:38,105 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.507) 0:01:22.924 ********** 2026-03-08 01:38:38,121 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:38,125 p=39346 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-08 01:38:38,125 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.020) 0:01:22.944 ********** 2026-03-08 01:38:38,146 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:38,150 p=39346 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-08 01:38:38,150 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.024) 0:01:22.969 ********** 2026-03-08 01:38:38,171 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:38,174 p=39346 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-08 01:38:38,174 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.024) 0:01:22.993 ********** 2026-03-08 01:38:38,193 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:38,198 p=39346 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-08 01:38:38,198 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.023) 0:01:23.017 ********** 2026-03-08 01:38:38,215 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:38,219 p=39346 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-08 01:38:38,219 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.021) 0:01:23.038 ********** 2026-03-08 01:38:38,236 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:38,240 p=39346 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-08 01:38:38,240 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.021) 0:01:23.059 ********** 2026-03-08 01:38:38,258 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:38,262 p=39346 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-08 01:38:38,262 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.021) 0:01:23.081 ********** 2026-03-08 01:38:38,280 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:38,284 p=39346 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-08 01:38:38,284 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.022) 0:01:23.104 ********** 2026-03-08 01:38:38,302 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:38,306 p=39346 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-08 01:38:38,306 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.021) 0:01:23.125 ********** 2026-03-08 01:38:38,324 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:38,339 p=39346 u=zuul n=ansible | PLAY [Verify logging pods have complete status in openstack] ******************* 2026-03-08 01:38:38,349 p=39346 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-08 01:38:38,349 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.042) 0:01:23.168 ********** 2026-03-08 01:38:38,454 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=bootstrap-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,457 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-network-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,460 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-os-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,463 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-certs-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,466 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-os-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,469 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=libvirt-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,471 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,474 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=neutron-metadata-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,476 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ovn-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,479 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=reboot-os-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,482 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=run-os-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,484 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ssh-known-hosts-edpm-deployment) 2026-03-08 01:38:38,487 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,490 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=validate-network-edpm-deployment-openstack-edpm-ipam) 2026-03-08 01:38:38,496 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:38,496 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:38 +0000 (0:00:00.147) 0:01:23.315 ********** 2026-03-08 01:38:39,072 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:39,077 p=39346 u=zuul n=ansible | TASK [common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:39,078 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:39 +0000 (0:00:00.581) 0:01:23.897 ********** 2026-03-08 01:38:39,646 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:39,651 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:39,651 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:39 +0000 (0:00:00.573) 0:01:24.470 ********** 2026-03-08 01:38:40,268 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:40,273 p=39346 u=zuul n=ansible | TASK [common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:40,273 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:40 +0000 (0:00:00.621) 0:01:25.092 ********** 2026-03-08 01:38:40,824 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:40,829 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:40,829 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:40 +0000 (0:00:00.556) 0:01:25.648 ********** 2026-03-08 01:38:41,452 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:41,457 p=39346 u=zuul n=ansible | TASK [common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:41,457 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:41 +0000 (0:00:00.628) 0:01:26.276 ********** 2026-03-08 01:38:41,980 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:41,984 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:41,985 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:41 +0000 (0:00:00.527) 0:01:26.804 ********** 2026-03-08 01:38:42,596 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:42,601 p=39346 u=zuul n=ansible | TASK [common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:42,601 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:42 +0000 (0:00:00.616) 0:01:27.420 ********** 2026-03-08 01:38:43,177 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:43,182 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:43,182 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:43 +0000 (0:00:00.581) 0:01:28.001 ********** 2026-03-08 01:38:43,787 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:43,793 p=39346 u=zuul n=ansible | TASK [common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:43,793 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:43 +0000 (0:00:00.610) 0:01:28.612 ********** 2026-03-08 01:38:44,324 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:44,330 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:44,330 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:44 +0000 (0:00:00.537) 0:01:29.150 ********** 2026-03-08 01:38:44,900 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:44,905 p=39346 u=zuul n=ansible | TASK [common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:44,905 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:44 +0000 (0:00:00.574) 0:01:29.725 ********** 2026-03-08 01:38:45,440 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:45,444 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:45,445 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:45 +0000 (0:00:00.539) 0:01:30.264 ********** 2026-03-08 01:38:46,034 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:46,039 p=39346 u=zuul n=ansible | TASK [common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:46,039 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:46 +0000 (0:00:00.594) 0:01:30.858 ********** 2026-03-08 01:38:46,553 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:46,557 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:46,557 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:46 +0000 (0:00:00.518) 0:01:31.376 ********** 2026-03-08 01:38:47,140 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:47,144 p=39346 u=zuul n=ansible | TASK [common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:47,145 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:47 +0000 (0:00:00.587) 0:01:31.964 ********** 2026-03-08 01:38:47,680 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:47,684 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:47,684 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:47 +0000 (0:00:00.539) 0:01:32.504 ********** 2026-03-08 01:38:48,224 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:48,228 p=39346 u=zuul n=ansible | TASK [common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:48,228 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:48 +0000 (0:00:00.543) 0:01:33.047 ********** 2026-03-08 01:38:48,729 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:48,733 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:48,733 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:48 +0000 (0:00:00.505) 0:01:33.552 ********** 2026-03-08 01:38:49,348 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:49,353 p=39346 u=zuul n=ansible | TASK [common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:49,353 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:49 +0000 (0:00:00.619) 0:01:34.172 ********** 2026-03-08 01:38:49,907 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:49,912 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:49,912 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:49 +0000 (0:00:00.558) 0:01:34.731 ********** 2026-03-08 01:38:50,518 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:50,525 p=39346 u=zuul n=ansible | TASK [common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:50,525 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:50 +0000 (0:00:00.613) 0:01:35.344 ********** 2026-03-08 01:38:51,136 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:51,142 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:51,142 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:51 +0000 (0:00:00.617) 0:01:35.961 ********** 2026-03-08 01:38:51,775 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:51,782 p=39346 u=zuul n=ansible | TASK [common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace] *** 2026-03-08 01:38:51,783 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:51 +0000 (0:00:00.640) 0:01:36.602 ********** 2026-03-08 01:38:52,343 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:52,349 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:52,350 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:52 +0000 (0:00:00.566) 0:01:37.169 ********** 2026-03-08 01:38:53,044 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:53,049 p=39346 u=zuul n=ansible | TASK [common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:53,049 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:53 +0000 (0:00:00.699) 0:01:37.868 ********** 2026-03-08 01:38:53,576 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:53,581 p=39346 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-08 01:38:53,581 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:53 +0000 (0:00:00.532) 0:01:38.400 ********** 2026-03-08 01:38:54,157 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:54,161 p=39346 u=zuul n=ansible | TASK [common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-08 01:38:54,162 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.580) 0:01:38.981 ********** 2026-03-08 01:38:54,679 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:54,683 p=39346 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-08 01:38:54,683 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.521) 0:01:39.502 ********** 2026-03-08 01:38:54,700 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,703 p=39346 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-08 01:38:54,703 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.020) 0:01:39.522 ********** 2026-03-08 01:38:54,719 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,723 p=39346 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-08 01:38:54,723 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.019) 0:01:39.542 ********** 2026-03-08 01:38:54,739 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,743 p=39346 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-08 01:38:54,744 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.020) 0:01:39.563 ********** 2026-03-08 01:38:54,760 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,765 p=39346 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-08 01:38:54,765 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.021) 0:01:39.584 ********** 2026-03-08 01:38:54,781 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,786 p=39346 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-08 01:38:54,786 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.021) 0:01:39.605 ********** 2026-03-08 01:38:54,801 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,805 p=39346 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-08 01:38:54,806 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.019) 0:01:39.625 ********** 2026-03-08 01:38:54,822 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,827 p=39346 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-08 01:38:54,827 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.021) 0:01:39.646 ********** 2026-03-08 01:38:54,844 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,848 p=39346 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-08 01:38:54,848 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.021) 0:01:39.667 ********** 2026-03-08 01:38:54,865 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,870 p=39346 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-08 01:38:54,870 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.021) 0:01:39.689 ********** 2026-03-08 01:38:54,887 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,902 p=39346 u=zuul n=ansible | PLAY [Verify the crds exist] *************************************************** 2026-03-08 01:38:54,913 p=39346 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-08 01:38:54,913 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.043) 0:01:39.732 ********** 2026-03-08 01:38:54,930 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,935 p=39346 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-08 01:38:54,935 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.021) 0:01:39.754 ********** 2026-03-08 01:38:54,952 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,956 p=39346 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-08 01:38:54,957 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.021) 0:01:39.776 ********** 2026-03-08 01:38:54,973 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,977 p=39346 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-08 01:38:54,977 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.020) 0:01:39.796 ********** 2026-03-08 01:38:54,994 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:54,998 p=39346 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-08 01:38:54,998 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:54 +0000 (0:00:00.020) 0:01:39.817 ********** 2026-03-08 01:38:55,043 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-internal) 2026-03-08 01:38:55,044 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-metadata-internal) 2026-03-08 01:38:55,045 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-novncproxy-cell1-public) 2026-03-08 01:38:55,047 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-public) 2026-03-08 01:38:55,052 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "nova-internal"] ******************************* 2026-03-08 01:38:55,052 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:55 +0000 (0:00:00.053) 0:01:39.871 ********** 2026-03-08 01:38:55,614 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:55,619 p=39346 u=zuul n=ansible | TASK [common : TEST Verify nova-internal service is running in openstack namespace] *** 2026-03-08 01:38:55,619 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:55 +0000 (0:00:00.567) 0:01:40.438 ********** 2026-03-08 01:38:55,638 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-internal is running." } 2026-03-08 01:38:55,643 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "nova-metadata-internal"] ********************** 2026-03-08 01:38:55,643 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:55 +0000 (0:00:00.023) 0:01:40.462 ********** 2026-03-08 01:38:56,128 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:56,133 p=39346 u=zuul n=ansible | TASK [common : TEST Verify nova-metadata-internal service is running in openstack namespace] *** 2026-03-08 01:38:56,133 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:56 +0000 (0:00:00.490) 0:01:40.952 ********** 2026-03-08 01:38:56,151 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-metadata-internal is running." } 2026-03-08 01:38:56,155 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "nova-novncproxy-cell1-public"] **************** 2026-03-08 01:38:56,155 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:56 +0000 (0:00:00.022) 0:01:40.974 ********** 2026-03-08 01:38:56,725 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:56,729 p=39346 u=zuul n=ansible | TASK [common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace] *** 2026-03-08 01:38:56,730 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:56 +0000 (0:00:00.574) 0:01:41.549 ********** 2026-03-08 01:38:56,758 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-novncproxy-cell1-public is running." } 2026-03-08 01:38:56,764 p=39346 u=zuul n=ansible | TASK [common : Verify Service - "nova-public"] ********************************* 2026-03-08 01:38:56,764 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:56 +0000 (0:00:00.034) 0:01:41.583 ********** 2026-03-08 01:38:57,245 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:57,249 p=39346 u=zuul n=ansible | TASK [common : TEST Verify nova-public service is running in openstack namespace] *** 2026-03-08 01:38:57,249 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:57 +0000 (0:00:00.485) 0:01:42.068 ********** 2026-03-08 01:38:57,267 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-public is running." } 2026-03-08 01:38:57,271 p=39346 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-08 01:38:57,271 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:57 +0000 (0:00:00.021) 0:01:42.090 ********** 2026-03-08 01:38:57,289 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:57,292 p=39346 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-08 01:38:57,293 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:57 +0000 (0:00:00.021) 0:01:42.112 ********** 2026-03-08 01:38:57,309 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:57,312 p=39346 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-08 01:38:57,313 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:57 +0000 (0:00:00.020) 0:01:42.132 ********** 2026-03-08 01:38:57,328 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:57,331 p=39346 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-08 01:38:57,331 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:57 +0000 (0:00:00.018) 0:01:42.150 ********** 2026-03-08 01:38:57,364 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=alertingrules.loki.grafana.com) 2026-03-08 01:38:57,365 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=lokistacks.loki.grafana.com) 2026-03-08 01:38:57,367 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=recordingrules.loki.grafana.com) 2026-03-08 01:38:57,368 p=39346 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=rulerconfigs.loki.grafana.com) 2026-03-08 01:38:57,372 p=39346 u=zuul n=ansible | TASK [common : Verify CRD "alertingrules.loki.grafana.com"] ******************** 2026-03-08 01:38:57,372 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:57 +0000 (0:00:00.041) 0:01:42.191 ********** 2026-03-08 01:38:57,890 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:57,896 p=39346 u=zuul n=ansible | TASK [common : TEST Verify CRD alertingrules.loki.grafana.com is found] ******** 2026-03-08 01:38:57,896 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:57 +0000 (0:00:00.523) 0:01:42.715 ********** 2026-03-08 01:38:57,915 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD alertingrules.loki.grafana.com is found." } 2026-03-08 01:38:57,920 p=39346 u=zuul n=ansible | TASK [common : Verify CRD "lokistacks.loki.grafana.com"] *********************** 2026-03-08 01:38:57,920 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:57 +0000 (0:00:00.024) 0:01:42.739 ********** 2026-03-08 01:38:58,513 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:58,518 p=39346 u=zuul n=ansible | TASK [common : TEST Verify CRD lokistacks.loki.grafana.com is found] *********** 2026-03-08 01:38:58,518 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:58 +0000 (0:00:00.597) 0:01:43.337 ********** 2026-03-08 01:38:58,542 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD lokistacks.loki.grafana.com is found." } 2026-03-08 01:38:58,546 p=39346 u=zuul n=ansible | TASK [common : Verify CRD "recordingrules.loki.grafana.com"] ******************* 2026-03-08 01:38:58,546 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:58 +0000 (0:00:00.028) 0:01:43.365 ********** 2026-03-08 01:38:59,115 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:59,119 p=39346 u=zuul n=ansible | TASK [common : TEST Verify CRD recordingrules.loki.grafana.com is found] ******* 2026-03-08 01:38:59,120 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:59 +0000 (0:00:00.573) 0:01:43.939 ********** 2026-03-08 01:38:59,136 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD recordingrules.loki.grafana.com is found." } 2026-03-08 01:38:59,141 p=39346 u=zuul n=ansible | TASK [common : Verify CRD "rulerconfigs.loki.grafana.com"] ********************* 2026-03-08 01:38:59,141 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:59 +0000 (0:00:00.021) 0:01:43.960 ********** 2026-03-08 01:38:59,675 p=39346 u=zuul n=ansible | ok: [controller] 2026-03-08 01:38:59,679 p=39346 u=zuul n=ansible | TASK [common : TEST Verify CRD rulerconfigs.loki.grafana.com is found] ********* 2026-03-08 01:38:59,679 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:59 +0000 (0:00:00.538) 0:01:44.498 ********** 2026-03-08 01:38:59,702 p=39346 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD rulerconfigs.loki.grafana.com is found." } 2026-03-08 01:38:59,707 p=39346 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-08 01:38:59,707 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:59 +0000 (0:00:00.027) 0:01:44.526 ********** 2026-03-08 01:38:59,729 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:59,733 p=39346 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-08 01:38:59,734 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:59 +0000 (0:00:00.026) 0:01:44.553 ********** 2026-03-08 01:38:59,758 p=39346 u=zuul n=ansible | skipping: [controller] 2026-03-08 01:38:59,774 p=39346 u=zuul n=ansible | PLAY RECAP ********************************************************************* 2026-03-08 01:38:59,774 p=39346 u=zuul n=ansible | compute-0 : ok=19 changed=0 unreachable=0 failed=0 skipped=24 rescued=0 ignored=0 2026-03-08 01:38:59,774 p=39346 u=zuul n=ansible | controller : ok=219 changed=0 unreachable=0 failed=0 skipped=63 rescued=0 ignored=0 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | Sunday 08 March 2026 01:38:59 +0000 (0:00:00.112) 0:01:44.665 ********** 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | =============================================================================== 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'internal']" --------- 2.83s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'public']" ---------------- 2.80s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'public']" ---------------- 2.69s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'internal']" -------------- 2.69s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute RHOSO-XXX ----------- 2.66s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'public']" --------- 2.63s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'public']" ---------- 2.62s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'internal']" -------- 2.62s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'public']" -------- 2.62s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'internal']" ------ 2.61s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'internal']" ------- 2.60s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'internal']" ----------- 2.59s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 2.53s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'internal']" -------------- 2.48s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'public']" ----------- 2.41s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'internal']" --------- 2.41s 2026-03-08 01:38:59,846 p=39346 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'public']" ------------- 2.38s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'public']" ----------- 2.36s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 2.13s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX --- 1.41s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.91s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf" -------- 0.88s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.72s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.70s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.69s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.69s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.64s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.63s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.62s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace --- 0.62s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.62s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.62s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get the openshift-logging project ------------------------------ 0.62s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.62s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.62s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Verify Service - "cluster-logging-operator-metrics" ------------ 0.61s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.61s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.60s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get the openstack-operators project ---------------------------- 0.60s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.60s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Verify CRD "lokistacks.loki.grafana.com" ----------------------- 0.60s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.60s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.59s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace --- 0.59s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.59s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : TEST Check openstackclient pod is Running in openstack namespace --- 0.58s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.58s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.58s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.58s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.58s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.57s 2026-03-08 01:38:59,847 p=39346 u=zuul n=ansible | common : Verify Service - "nova-novncproxy-cell1-public" ---------------- 0.57s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Verify CRD "recordingrules.loki.grafana.com" ------------------- 0.57s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace --- 0.57s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.57s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Verify subscription "loki-operator" ---------------------------- 0.57s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace --- 0.57s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.57s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-http" ------------------- 0.57s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Verify Service - "nova-internal" ------------------------------- 0.57s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace --- 0.57s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace --- 0.56s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.56s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-grpc" ------------------- 0.56s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.56s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-http" ------------------ 0.56s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.54s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-grpc" --------------- 0.54s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check collector pod is Running in openshift-logging namespace --- 0.54s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.54s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.54s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-grpc" ------------ 0.54s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-http" --------------- 0.54s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Verify CRD "rulerconfigs.loki.grafana.com" --------------------- 0.54s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.54s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace --- 0.54s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.53s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Get the openshift-openstack-infra project ---------------------- 0.53s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.53s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace --- 0.53s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.53s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.53s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.53s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : Verify CRD "alertingrules.loki.grafana.com" -------------------- 0.52s 2026-03-08 01:38:59,848 p=39346 u=zuul n=ansible | common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace --- 0.52s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.52s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.52s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.52s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.51s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : TEST Check minio pod is Running in minio-dev namespace -------- 0.51s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-http" ----------------- 0.51s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.51s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-grpc" ------------------ 0.50s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace --- 0.49s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify Service - "nova-metadata-internal" ---------------------- 0.49s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace --- 0.49s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify Service - "nova-public" --------------------------------- 0.49s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-http" ------------ 0.48s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Get the openshift project -------------------------------------- 0.48s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-grpc" ----------------- 0.47s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-gossip-ring" -------------------- 0.46s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify Service - "openstack-logging" --------------------------- 0.45s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-gateway-http" ------------------- 0.45s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-http" ------------- 0.44s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-grpc" ------------- 0.44s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.18s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.15s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.14s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.11s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute RHOSO-XXX ----------- 0.10s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.09s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.09s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : TEST Verify node_exporter container status -------------------- 0.09s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | telemetry_logging : Verify journal entries ------------------------------ 0.08s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX --- 0.08s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists --- 0.07s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.06s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : TEST Get loki-operator 2 packagemanifest ---------------------- 0.06s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.05s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.05s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.05s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : TEST Verify ceilometer_agent_compute container status --------- 0.05s 2026-03-08 01:38:59,849 p=39346 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.05s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.05s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Check that barbican public endpoint exists --------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Check that keystone public endpoint exists --------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Check that placement internal endpoint exists ------------ 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Check that keystone internal endpoint exists ------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Check that neutron internal endpoint exists -------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Check that cinderv3 internal endpoint exists ------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Check that placement public endpoint exists -------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Check that cinderv3 public endpoint exists --------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Check that swift public endpoint exists ------------------ 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace --- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace --- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Check that swift internal endpoint exists ---------------- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : TEST Verify openshift-logging project exists ------------------ 0.03s 2026-03-08 01:38:59,850 p=39346 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace --- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Check that nova internal endpoint exists ----------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Check that barbican internal endpoint exists ------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Check that nova public endpoint exists ------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Check that glance internal endpoint exists --------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace --- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify CRD lokistacks.loki.grafana.com is found ---------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify CRD rulerconfigs.loki.grafana.com is found -------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify openshift project exists -------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace --- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify openstack-operators project exists ---------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify CRD alertingrules.loki.grafana.com is found ------- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify nova-internal service is running in openstack namespace --- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Check that glance public endpoint exists ----------------- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : TEST Check that neutron public endpoint exists ---------------- 0.02s 2026-03-08 01:38:59,851 p=39346 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : TEST Verify openshift-openstack-infra project exists ---------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : TEST Verify nova-metadata-internal service is running in openstack namespace --- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : TEST Verify CRD recordingrules.loki.grafana.com is found ------ 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : TEST Verify nova-public service is running in openstack namespace --- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : TEST Verify openstack-logging service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-08 01:38:59,852 p=39346 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace --- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-08 01:38:59,853 p=39346 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s