2026-03-13 14:49:53,984 p=37634 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace

2026-03-13 14:49:53,984 p=37634 u=zuul n=ansible | PLAY [Verify logging journalctl identifiers] ***********************************
2026-03-13 14:49:53,992 p=37634 u=zuul n=ansible | TASK [Gathering Facts] *********************************************************
2026-03-13 14:49:53,992 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:49:53 +0000 (0:00:00.010)       0:00:00.010 ********** 
2026-03-13 14:49:56,443 p=37634 u=zuul n=ansible | ok: [compute-0]
2026-03-13 14:49:56,473 p=37634 u=zuul n=ansible | TASK [telemetry_logging : Verify journal entries] ******************************
2026-03-13 14:49:56,473 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:49:56 +0000 (0:00:02.481)       0:00:02.491 ********** 
2026-03-13 14:49:56,505 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=ceilometer_agent_compute)
2026-03-13 14:49:56,507 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=nova_compute)
2026-03-13 14:49:56,516 p=37634 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute
RHOSO-XXX] ***
2026-03-13 14:49:56,516 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:49:56 +0000 (0:00:00.043)       0:00:02.534 ********** 
2026-03-13 14:49:57,432 p=37634 u=zuul n=ansible | ok: [compute-0]
2026-03-13 14:49:57,443 p=37634 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute
RHOSO-XXX] ***
2026-03-13 14:49:57,444 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:49:57 +0000 (0:00:00.927)       0:00:03.462 ********** 
2026-03-13 14:49:57,493 p=37634 u=zuul n=ansible | ok: [compute-0] => {
    "changed": false,
    "msg": "The test passed!"
}
2026-03-13 14:49:57,505 p=37634 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute
RHOSO-XXX] *************
2026-03-13 14:49:57,505 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:49:57 +0000 (0:00:00.061)       0:00:03.523 ********** 
2026-03-13 14:49:59,844 p=37634 u=zuul n=ansible | ok: [compute-0]
2026-03-13 14:49:59,906 p=37634 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute
RHOSO-XXX] *************
2026-03-13 14:49:59,906 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:49:59 +0000 (0:00:02.401)       0:00:05.924 ********** 
2026-03-13 14:49:59,982 p=37634 u=zuul n=ansible | ok: [compute-0] => {
    "changed": false,
    "msg": "The test passed!"
}
2026-03-13 14:49:59,996 p=37634 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-13 14:49:59,996 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:49:59 +0000 (0:00:00.089)       0:00:06.014 ********** 
2026-03-13 14:50:00,011 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:00,018 p=37634 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-13 14:50:00,019 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:00 +0000 (0:00:00.022)       0:00:06.037 ********** 
2026-03-13 14:50:00,035 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:00,042 p=37634 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-13 14:50:00,042 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:00 +0000 (0:00:00.023)       0:00:06.060 ********** 
2026-03-13 14:50:00,059 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:00,066 p=37634 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-13 14:50:00,066 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:00 +0000 (0:00:00.023)       0:00:06.084 ********** 
2026-03-13 14:50:00,081 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:00,088 p=37634 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-13 14:50:00,088 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:00 +0000 (0:00:00.021)       0:00:06.106 ********** 
2026-03-13 14:50:00,103 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:00,110 p=37634 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-13 14:50:00,110 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:00 +0000 (0:00:00.022)       0:00:06.128 ********** 
2026-03-13 14:50:00,140 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/file_tests.yml for compute-0 => (item=/etc/rsyslog.d/10-telemetry.conf)
2026-03-13 14:50:00,155 p=37634 u=zuul n=ansible | TASK [common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf"] ********
2026-03-13 14:50:00,155 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:00 +0000 (0:00:00.045)       0:00:06.173 ********** 
2026-03-13 14:50:00,896 p=37634 u=zuul n=ansible | ok: [compute-0]
2026-03-13 14:50:00,906 p=37634 u=zuul n=ansible | TASK [common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists] ***
2026-03-13 14:50:00,906 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:00 +0000 (0:00:00.750)       0:00:06.924 ********** 
2026-03-13 14:50:00,949 p=37634 u=zuul n=ansible | ok: [compute-0] => {
    "changed": false,
    "msg": "The test passed"
}
2026-03-13 14:50:00,957 p=37634 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-13 14:50:00,957 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:00 +0000 (0:00:00.051)       0:00:06.976 ********** 
2026-03-13 14:50:00,975 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:00,983 p=37634 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-13 14:50:00,983 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:00 +0000 (0:00:00.025)       0:00:07.001 ********** 
2026-03-13 14:50:01,000 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:01,008 p=37634 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-13 14:50:01,008 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:01 +0000 (0:00:00.024)       0:00:07.026 ********** 
2026-03-13 14:50:01,025 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:01,033 p=37634 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-13 14:50:01,033 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:01 +0000 (0:00:00.025)       0:00:07.051 ********** 
2026-03-13 14:50:01,051 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:01,061 p=37634 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-13 14:50:01,062 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:01 +0000 (0:00:00.028)       0:00:07.080 ********** 
2026-03-13 14:50:01,081 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:01,122 p=37634 u=zuul n=ansible | PLAY [Run container tests which require root on compute nodes] *****************
2026-03-13 14:50:01,129 p=37634 u=zuul n=ansible | TASK [Gathering Facts] *********************************************************
2026-03-13 14:50:01,129 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:01 +0000 (0:00:00.067)       0:00:07.147 ********** 
2026-03-13 14:50:02,919 p=37634 u=zuul n=ansible | ok: [compute-0]
2026-03-13 14:50:02,939 p=37634 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-13 14:50:02,940 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:02 +0000 (0:00:01.810)       0:00:08.958 ********** 
2026-03-13 14:50:02,958 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:02,965 p=37634 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-13 14:50:02,966 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:02 +0000 (0:00:00.025)       0:00:08.984 ********** 
2026-03-13 14:50:02,982 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:02,990 p=37634 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-13 14:50:02,990 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:02 +0000 (0:00:00.024)       0:00:09.008 ********** 
2026-03-13 14:50:03,007 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:03,015 p=37634 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-13 14:50:03,015 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:03 +0000 (0:00:00.024)       0:00:09.033 ********** 
2026-03-13 14:50:03,033 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:03,040 p=37634 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-13 14:50:03,040 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:03 +0000 (0:00:00.025)       0:00:09.058 ********** 
2026-03-13 14:50:03,060 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:03,068 p=37634 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-13 14:50:03,068 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:03 +0000 (0:00:00.028)       0:00:09.087 ********** 
2026-03-13 14:50:03,086 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:03,096 p=37634 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-13 14:50:03,096 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:03 +0000 (0:00:00.027)       0:00:09.114 ********** 
2026-03-13 14:50:03,114 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:03,121 p=37634 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-13 14:50:03,121 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:03 +0000 (0:00:00.024)       0:00:09.139 ********** 
2026-03-13 14:50:03,140 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:03,148 p=37634 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-13 14:50:03,149 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:03 +0000 (0:00:00.027)       0:00:09.167 ********** 
2026-03-13 14:50:03,223 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:03,229 p=37634 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-13 14:50:03,229 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:03 +0000 (0:00:00.080)       0:00:09.247 ********** 
2026-03-13 14:50:03,247 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:03,257 p=37634 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-13 14:50:03,257 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:03 +0000 (0:00:00.027)       0:00:09.275 ********** 
2026-03-13 14:50:03,293 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=ceilometer_agent_compute)
2026-03-13 14:50:03,297 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=node_exporter)
2026-03-13 14:50:03,308 p=37634 u=zuul n=ansible | TASK [common : Get container status] *******************************************
2026-03-13 14:50:03,308 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:03 +0000 (0:00:00.051)       0:00:09.326 ********** 
2026-03-13 14:50:04,088 p=37634 u=zuul n=ansible | ok: [compute-0]
2026-03-13 14:50:04,095 p=37634 u=zuul n=ansible | TASK [common : Show the container name and status] *****************************
2026-03-13 14:50:04,096 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:04 +0000 (0:00:00.788)       0:00:10.114 ********** 
2026-03-13 14:50:04,124 p=37634 u=zuul n=ansible | ok: [compute-0] => {
    "container_status.stdout": "ceilometer_agent_compute Up 4 minutes (healthy)"
}
2026-03-13 14:50:04,131 p=37634 u=zuul n=ansible | TASK [common : Show the containers] ********************************************
2026-03-13 14:50:04,131 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:04 +0000 (0:00:00.035)       0:00:10.149 ********** 
2026-03-13 14:50:04,175 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:04,186 p=37634 u=zuul n=ansible | TASK [common : Show the output of container list] ******************************
2026-03-13 14:50:04,186 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:04 +0000 (0:00:00.054)       0:00:10.204 ********** 
2026-03-13 14:50:04,210 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:04,221 p=37634 u=zuul n=ansible | TASK [common : TEST Verify ceilometer_agent_compute container status] **********
2026-03-13 14:50:04,221 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:04 +0000 (0:00:00.034)       0:00:10.239 ********** 
2026-03-13 14:50:04,254 p=37634 u=zuul n=ansible | ok: [compute-0] => {
    "changed": false,
    "msg": "Container 'ceilometer_agent_compute' is in 'healthy' status."
}
2026-03-13 14:50:04,266 p=37634 u=zuul n=ansible | TASK [common : Get container status] *******************************************
2026-03-13 14:50:04,266 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:04 +0000 (0:00:00.045)       0:00:10.285 ********** 
2026-03-13 14:50:05,032 p=37634 u=zuul n=ansible | ok: [compute-0]
2026-03-13 14:50:05,045 p=37634 u=zuul n=ansible | TASK [common : Show the container name and status] *****************************
2026-03-13 14:50:05,045 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:05 +0000 (0:00:00.778)       0:00:11.063 ********** 
2026-03-13 14:50:05,068 p=37634 u=zuul n=ansible | ok: [compute-0] => {
    "container_status.stdout": "node_exporter Up 4 minutes (healthy)"
}
2026-03-13 14:50:05,075 p=37634 u=zuul n=ansible | TASK [common : Show the containers] ********************************************
2026-03-13 14:50:05,076 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:05 +0000 (0:00:00.030)       0:00:11.094 ********** 
2026-03-13 14:50:05,111 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:05,124 p=37634 u=zuul n=ansible | TASK [common : Show the output of container list] ******************************
2026-03-13 14:50:05,124 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:05 +0000 (0:00:00.048)       0:00:11.143 ********** 
2026-03-13 14:50:05,154 p=37634 u=zuul n=ansible | skipping: [compute-0]
2026-03-13 14:50:05,163 p=37634 u=zuul n=ansible | TASK [common : TEST Verify node_exporter container status] *********************
2026-03-13 14:50:05,164 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:05 +0000 (0:00:00.039)       0:00:11.182 ********** 
2026-03-13 14:50:05,196 p=37634 u=zuul n=ansible | ok: [compute-0] => {
    "changed": false,
    "msg": "Container 'node_exporter' is in 'healthy' status."
}
2026-03-13 14:50:05,232 p=37634 u=zuul n=ansible | PLAY [Verify logging projects, endpoints, credentials, nodes, pods, services, manifests and subscriptions] ***
2026-03-13 14:50:05,244 p=37634 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-13 14:50:05,244 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:05 +0000 (0:00:00.080)       0:00:11.262 ********** 
2026-03-13 14:50:05,277 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-operator-controller-manager)
2026-03-13 14:50:05,280 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstack-operator-controller-manager)
2026-03-13 14:50:05,286 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:50:05,286 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:05 +0000 (0:00:00.041)       0:00:11.304 ********** 
2026-03-13 14:50:06,156 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:06,161 p=37634 u=zuul n=ansible | TASK [common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace] ***
2026-03-13 14:50:06,161 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:06 +0000 (0:00:00.875)       0:00:12.179 ********** 
2026-03-13 14:50:06,754 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:06,760 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:50:06,760 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:06 +0000 (0:00:00.599)       0:00:12.779 ********** 
2026-03-13 14:50:07,339 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:07,344 p=37634 u=zuul n=ansible | TASK [common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace] ***
2026-03-13 14:50:07,344 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:07 +0000 (0:00:00.583)       0:00:13.363 ********** 
2026-03-13 14:50:07,931 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:07,936 p=37634 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-13 14:50:07,936 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:07 +0000 (0:00:00.591)       0:00:13.954 ********** 
2026-03-13 14:50:07,963 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/subscription_tests.yml for controller => (item=loki-operator)
2026-03-13 14:50:07,972 p=37634 u=zuul n=ansible | TASK [common : Verify subscription "loki-operator"] ****************************
2026-03-13 14:50:07,972 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:07 +0000 (0:00:00.036)       0:00:13.991 ********** 
2026-03-13 14:50:08,498 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:08,504 p=37634 u=zuul n=ansible | TASK [common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace] ***
2026-03-13 14:50:08,504 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:08 +0000 (0:00:00.531)       0:00:14.522 ********** 
2026-03-13 14:50:08,520 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "subscription loki-operator is found."
}
2026-03-13 14:50:08,523 p=37634 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-13 14:50:08,524 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:08 +0000 (0:00:00.019)       0:00:14.542 ********** 
2026-03-13 14:50:08,603 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'public'])
2026-03-13 14:50:08,605 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'internal'])
2026-03-13 14:50:08,606 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'public'])
2026-03-13 14:50:08,608 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'internal'])
2026-03-13 14:50:08,610 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'public'])
2026-03-13 14:50:08,612 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'internal'])
2026-03-13 14:50:08,613 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'public'])
2026-03-13 14:50:08,615 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'internal'])
2026-03-13 14:50:08,617 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'public'])
2026-03-13 14:50:08,618 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'internal'])
2026-03-13 14:50:08,620 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'public'])
2026-03-13 14:50:08,622 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'internal'])
2026-03-13 14:50:08,623 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'public'])
2026-03-13 14:50:08,625 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'internal'])
2026-03-13 14:50:08,626 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'public'])
2026-03-13 14:50:08,628 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'internal'])
2026-03-13 14:50:08,638 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'public']"] ****************
2026-03-13 14:50:08,638 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:08 +0000 (0:00:00.114)       0:00:14.656 ********** 
2026-03-13 14:50:11,133 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:11,140 p=37634 u=zuul n=ansible | TASK [common : TEST Check that nova public endpoint exists] ********************
2026-03-13 14:50:11,140 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:11 +0000 (0:00:02.501)       0:00:17.158 ********** 
2026-03-13 14:50:11,170 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint nova is found."
}
2026-03-13 14:50:11,175 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'internal']"] **************
2026-03-13 14:50:11,175 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:11 +0000 (0:00:00.035)       0:00:17.194 ********** 
2026-03-13 14:50:13,628 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:13,636 p=37634 u=zuul n=ansible | TASK [common : TEST Check that nova internal endpoint exists] ******************
2026-03-13 14:50:13,636 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:13 +0000 (0:00:02.460)       0:00:19.654 ********** 
2026-03-13 14:50:13,663 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint nova is found."
}
2026-03-13 14:50:13,670 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'public']"] *********
2026-03-13 14:50:13,671 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:13 +0000 (0:00:00.034)       0:00:19.689 ********** 
2026-03-13 14:50:16,209 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:16,221 p=37634 u=zuul n=ansible | TASK [common : TEST Check that placement public endpoint exists] ***************
2026-03-13 14:50:16,221 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:16 +0000 (0:00:02.550)       0:00:22.239 ********** 
2026-03-13 14:50:16,240 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint placement is found."
}
2026-03-13 14:50:16,252 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'internal']"] *******
2026-03-13 14:50:16,252 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:16 +0000 (0:00:00.031)       0:00:22.270 ********** 
2026-03-13 14:50:19,024 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:19,031 p=37634 u=zuul n=ansible | TASK [common : TEST Check that placement internal endpoint exists] *************
2026-03-13 14:50:19,032 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:19 +0000 (0:00:02.779)       0:00:25.050 ********** 
2026-03-13 14:50:19,051 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint placement is found."
}
2026-03-13 14:50:19,057 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'public']"] **********
2026-03-13 14:50:19,058 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:19 +0000 (0:00:00.025)       0:00:25.076 ********** 
2026-03-13 14:50:21,653 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:21,661 p=37634 u=zuul n=ansible | TASK [common : TEST Check that swift public endpoint exists] *******************
2026-03-13 14:50:21,662 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:21 +0000 (0:00:02.604)       0:00:27.680 ********** 
2026-03-13 14:50:21,684 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint swift is found."
}
2026-03-13 14:50:21,689 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'internal']"] ********
2026-03-13 14:50:21,689 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:21 +0000 (0:00:00.027)       0:00:27.707 ********** 
2026-03-13 14:50:24,193 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:24,198 p=37634 u=zuul n=ansible | TASK [common : TEST Check that swift internal endpoint exists] *****************
2026-03-13 14:50:24,199 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:24 +0000 (0:00:02.509)       0:00:30.217 ********** 
2026-03-13 14:50:24,223 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint swift is found."
}
2026-03-13 14:50:24,228 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'public']"] ***********
2026-03-13 14:50:24,228 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:24 +0000 (0:00:00.029)       0:00:30.246 ********** 
2026-03-13 14:50:26,740 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:26,746 p=37634 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 public endpoint exists] ****************
2026-03-13 14:50:26,746 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:26 +0000 (0:00:02.517)       0:00:32.764 ********** 
2026-03-13 14:50:26,767 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint cinderv3 is found."
}
2026-03-13 14:50:26,774 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'internal']"] *********
2026-03-13 14:50:26,774 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:26 +0000 (0:00:00.028)       0:00:32.792 ********** 
2026-03-13 14:50:29,219 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:29,225 p=37634 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 internal endpoint exists] **************
2026-03-13 14:50:29,226 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:29 +0000 (0:00:02.451)       0:00:35.244 ********** 
2026-03-13 14:50:29,249 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint cinderv3 is found."
}
2026-03-13 14:50:29,255 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'public']"] ********
2026-03-13 14:50:29,255 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:29 +0000 (0:00:00.029)       0:00:35.273 ********** 
2026-03-13 14:50:31,590 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:31,597 p=37634 u=zuul n=ansible | TASK [common : TEST Check that barbican public endpoint exists] ****************
2026-03-13 14:50:31,598 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:31 +0000 (0:00:02.342)       0:00:37.616 ********** 
2026-03-13 14:50:31,618 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint barbican is found."
}
2026-03-13 14:50:31,623 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'internal']"] ******
2026-03-13 14:50:31,623 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:31 +0000 (0:00:00.024)       0:00:37.641 ********** 
2026-03-13 14:50:34,143 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:34,149 p=37634 u=zuul n=ansible | TASK [common : TEST Check that barbican internal endpoint exists] **************
2026-03-13 14:50:34,149 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:34 +0000 (0:00:02.526)       0:00:40.167 ********** 
2026-03-13 14:50:34,170 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint barbican is found."
}
2026-03-13 14:50:34,176 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'public']"] ***********
2026-03-13 14:50:34,176 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:34 +0000 (0:00:00.027)       0:00:40.195 ********** 
2026-03-13 14:50:36,728 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:36,734 p=37634 u=zuul n=ansible | TASK [common : TEST Check that keystone public endpoint exists] ****************
2026-03-13 14:50:36,735 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:36 +0000 (0:00:02.558)       0:00:42.753 ********** 
2026-03-13 14:50:36,753 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint keystone is found."
}
2026-03-13 14:50:36,758 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'internal']"] *********
2026-03-13 14:50:36,758 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:36 +0000 (0:00:00.023)       0:00:42.776 ********** 
2026-03-13 14:50:39,314 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:39,324 p=37634 u=zuul n=ansible | TASK [common : TEST Check that keystone internal endpoint exists] **************
2026-03-13 14:50:39,325 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:39 +0000 (0:00:02.566)       0:00:45.343 ********** 
2026-03-13 14:50:39,346 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint keystone is found."
}
2026-03-13 14:50:39,353 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'public']"] ****************
2026-03-13 14:50:39,353 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:39 +0000 (0:00:00.028)       0:00:45.371 ********** 
2026-03-13 14:50:42,335 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:42,342 p=37634 u=zuul n=ansible | TASK [common : TEST Check that glance public endpoint exists] ******************
2026-03-13 14:50:42,342 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:42 +0000 (0:00:02.989)       0:00:48.360 ********** 
2026-03-13 14:50:42,367 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint glance is found."
}
2026-03-13 14:50:42,373 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'internal']"] **************
2026-03-13 14:50:42,373 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:42 +0000 (0:00:00.030)       0:00:48.391 ********** 
2026-03-13 14:50:46,055 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:46,063 p=37634 u=zuul n=ansible | TASK [common : TEST Check that glance internal endpoint exists] ****************
2026-03-13 14:50:46,063 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:46 +0000 (0:00:03.690)       0:00:52.082 ********** 
2026-03-13 14:50:46,090 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint glance is found."
}
2026-03-13 14:50:46,097 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'public']"] *************
2026-03-13 14:50:46,097 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:46 +0000 (0:00:00.033)       0:00:52.115 ********** 
2026-03-13 14:50:49,190 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:49,201 p=37634 u=zuul n=ansible | TASK [common : TEST Check that neutron public endpoint exists] *****************
2026-03-13 14:50:49,202 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:49 +0000 (0:00:03.104)       0:00:55.220 ********** 
2026-03-13 14:50:49,238 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint neutron is found."
}
2026-03-13 14:50:49,248 p=37634 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'internal']"] ***********
2026-03-13 14:50:49,248 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:49 +0000 (0:00:00.046)       0:00:55.266 ********** 
2026-03-13 14:50:51,730 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:51,735 p=37634 u=zuul n=ansible | TASK [common : TEST Check that neutron internal endpoint exists] ***************
2026-03-13 14:50:51,736 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:51 +0000 (0:00:02.487)       0:00:57.754 ********** 
2026-03-13 14:50:51,753 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint neutron is found."
}
2026-03-13 14:50:51,758 p=37634 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-13 14:50:51,758 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:51 +0000 (0:00:00.022)       0:00:57.776 ********** 
2026-03-13 14:50:51,792 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-openstack-infra)
2026-03-13 14:50:51,794 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift)
2026-03-13 14:50:51,796 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openstack-operators)
2026-03-13 14:50:51,797 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-logging)
2026-03-13 14:50:51,823 p=37634 u=zuul n=ansible | TASK [common : Get the openshift-openstack-infra project] **********************
2026-03-13 14:50:51,823 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:51 +0000 (0:00:00.064)       0:00:57.841 ********** 
2026-03-13 14:50:52,303 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:52,308 p=37634 u=zuul n=ansible | TASK [common : TEST Verify openshift-openstack-infra project exists] ***********
2026-03-13 14:50:52,308 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:52 +0000 (0:00:00.485)       0:00:58.326 ********** 
2026-03-13 14:50:52,327 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "project openshift-openstack-infra is found."
}
2026-03-13 14:50:52,332 p=37634 u=zuul n=ansible | TASK [common : Get the openshift project] **************************************
2026-03-13 14:50:52,333 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:52 +0000 (0:00:00.024)       0:00:58.351 ********** 
2026-03-13 14:50:52,860 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:52,868 p=37634 u=zuul n=ansible | TASK [common : TEST Verify openshift project exists] ***************************
2026-03-13 14:50:52,868 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:52 +0000 (0:00:00.535)       0:00:58.886 ********** 
2026-03-13 14:50:52,891 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "project openshift is found."
}
2026-03-13 14:50:52,896 p=37634 u=zuul n=ansible | TASK [common : Get the openstack-operators project] ****************************
2026-03-13 14:50:52,896 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:52 +0000 (0:00:00.028)       0:00:58.914 ********** 
2026-03-13 14:50:53,429 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:53,435 p=37634 u=zuul n=ansible | TASK [common : TEST Verify openstack-operators project exists] *****************
2026-03-13 14:50:53,435 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:53 +0000 (0:00:00.539)       0:00:59.453 ********** 
2026-03-13 14:50:53,453 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "project openstack-operators is found."
}
2026-03-13 14:50:53,459 p=37634 u=zuul n=ansible | TASK [common : Get the openshift-logging project] ******************************
2026-03-13 14:50:53,460 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:53 +0000 (0:00:00.024)       0:00:59.478 ********** 
2026-03-13 14:50:53,954 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:53,959 p=37634 u=zuul n=ansible | TASK [common : TEST Verify openshift-logging project exists] *******************
2026-03-13 14:50:53,960 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:53 +0000 (0:00:00.500)       0:00:59.978 ********** 
2026-03-13 14:50:53,978 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "project openshift-logging is found."
}
2026-03-13 14:50:53,983 p=37634 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-13 14:50:53,983 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:53 +0000 (0:00:00.023)       0:01:00.001 ********** 
2026-03-13 14:50:54,090 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=cluster-logging-operator-metrics)
2026-03-13 14:50:54,092 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-grpc)
2026-03-13 14:50:54,094 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-http)
2026-03-13 14:50:54,095 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-grpc)
2026-03-13 14:50:54,097 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-http)
2026-03-13 14:50:54,099 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gateway-http)
2026-03-13 14:50:54,101 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gossip-ring)
2026-03-13 14:50:54,102 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-grpc)
2026-03-13 14:50:54,104 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-http)
2026-03-13 14:50:54,106 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-grpc)
2026-03-13 14:50:54,107 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-http)
2026-03-13 14:50:54,109 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-grpc)
2026-03-13 14:50:54,111 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-http)
2026-03-13 14:50:54,113 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-grpc)
2026-03-13 14:50:54,115 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-http)
2026-03-13 14:50:54,116 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=openstack-logging)
2026-03-13 14:50:54,144 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "cluster-logging-operator-metrics"] ************
2026-03-13 14:50:54,144 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:54 +0000 (0:00:00.161)       0:01:00.162 ********** 
2026-03-13 14:50:54,728 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:54,734 p=37634 u=zuul n=ansible | TASK [common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace] ***
2026-03-13 14:50:54,734 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:54 +0000 (0:00:00.590)       0:01:00.752 ********** 
2026-03-13 14:50:54,751 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service cluster-logging-operator-metrics is running."
}
2026-03-13 14:50:54,758 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-grpc"] *****************
2026-03-13 14:50:54,758 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:54 +0000 (0:00:00.023)       0:01:00.776 ********** 
2026-03-13 14:50:55,332 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:55,338 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace] ***
2026-03-13 14:50:55,339 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:55 +0000 (0:00:00.580)       0:01:01.357 ********** 
2026-03-13 14:50:55,358 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-compactor-grpc is running."
}
2026-03-13 14:50:55,364 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-http"] *****************
2026-03-13 14:50:55,364 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:55 +0000 (0:00:00.025)       0:01:01.382 ********** 
2026-03-13 14:50:55,847 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:55,852 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace] ***
2026-03-13 14:50:55,852 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:55 +0000 (0:00:00.488)       0:01:01.870 ********** 
2026-03-13 14:50:55,871 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-compactor-http is running."
}
2026-03-13 14:50:55,875 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-grpc"] ***************
2026-03-13 14:50:55,875 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:55 +0000 (0:00:00.023)       0:01:01.894 ********** 
2026-03-13 14:50:56,372 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:56,378 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace] ***
2026-03-13 14:50:56,378 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:56 +0000 (0:00:00.502)       0:01:02.396 ********** 
2026-03-13 14:50:56,399 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-distributor-grpc is running."
}
2026-03-13 14:50:56,404 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-http"] ***************
2026-03-13 14:50:56,404 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:56 +0000 (0:00:00.026)       0:01:02.422 ********** 
2026-03-13 14:50:56,914 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:56,920 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace] ***
2026-03-13 14:50:56,920 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:56 +0000 (0:00:00.515)       0:01:02.938 ********** 
2026-03-13 14:50:56,938 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-distributor-http is running."
}
2026-03-13 14:50:56,944 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gateway-http"] *******************
2026-03-13 14:50:56,944 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:56 +0000 (0:00:00.023)       0:01:02.962 ********** 
2026-03-13 14:50:57,468 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:57,475 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace] ***
2026-03-13 14:50:57,475 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:57 +0000 (0:00:00.531)       0:01:03.493 ********** 
2026-03-13 14:50:57,494 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-gateway-http is running."
}
2026-03-13 14:50:57,501 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gossip-ring"] ********************
2026-03-13 14:50:57,501 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:57 +0000 (0:00:00.025)       0:01:03.519 ********** 
2026-03-13 14:50:58,061 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:58,066 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace] ***
2026-03-13 14:50:58,067 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:58 +0000 (0:00:00.565)       0:01:04.085 ********** 
2026-03-13 14:50:58,089 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-gossip-ring is running."
}
2026-03-13 14:50:58,094 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-grpc"] *************
2026-03-13 14:50:58,094 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:58 +0000 (0:00:00.027)       0:01:04.112 ********** 
2026-03-13 14:50:58,602 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:58,608 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace] ***
2026-03-13 14:50:58,608 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:58 +0000 (0:00:00.514)       0:01:04.627 ********** 
2026-03-13 14:50:58,629 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-index-gateway-grpc is running."
}
2026-03-13 14:50:58,635 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-http"] *************
2026-03-13 14:50:58,635 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:58 +0000 (0:00:00.026)       0:01:04.653 ********** 
2026-03-13 14:50:59,172 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:59,177 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace] ***
2026-03-13 14:50:59,178 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:59 +0000 (0:00:00.542)       0:01:05.196 ********** 
2026-03-13 14:50:59,196 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-index-gateway-http is running."
}
2026-03-13 14:50:59,201 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-grpc"] ******************
2026-03-13 14:50:59,202 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:59 +0000 (0:00:00.024)       0:01:05.220 ********** 
2026-03-13 14:50:59,702 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:50:59,708 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace] ***
2026-03-13 14:50:59,708 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:59 +0000 (0:00:00.506)       0:01:05.726 ********** 
2026-03-13 14:50:59,731 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-ingester-grpc is running."
}
2026-03-13 14:50:59,736 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-http"] ******************
2026-03-13 14:50:59,737 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:50:59 +0000 (0:00:00.028)       0:01:05.755 ********** 
2026-03-13 14:51:00,284 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:00,290 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace] ***
2026-03-13 14:51:00,290 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:00 +0000 (0:00:00.553)       0:01:06.308 ********** 
2026-03-13 14:51:00,308 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-ingester-http is running."
}
2026-03-13 14:51:00,313 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-grpc"] *******************
2026-03-13 14:51:00,313 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:00 +0000 (0:00:00.023)       0:01:06.332 ********** 
2026-03-13 14:51:00,871 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:00,880 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace] ***
2026-03-13 14:51:00,880 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:00 +0000 (0:00:00.566)       0:01:06.898 ********** 
2026-03-13 14:51:00,900 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-querier-grpc is running."
}
2026-03-13 14:51:00,907 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-http"] *******************
2026-03-13 14:51:00,907 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:00 +0000 (0:00:00.026)       0:01:06.925 ********** 
2026-03-13 14:51:01,474 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:01,479 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace] ***
2026-03-13 14:51:01,480 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:01 +0000 (0:00:00.572)       0:01:07.498 ********** 
2026-03-13 14:51:01,502 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-querier-http is running."
}
2026-03-13 14:51:01,508 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-grpc"] ************
2026-03-13 14:51:01,508 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:01 +0000 (0:00:00.028)       0:01:07.526 ********** 
2026-03-13 14:51:02,054 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:02,059 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace] ***
2026-03-13 14:51:02,059 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:02 +0000 (0:00:00.550)       0:01:08.077 ********** 
2026-03-13 14:51:02,077 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-query-frontend-grpc is running."
}
2026-03-13 14:51:02,082 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-http"] ************
2026-03-13 14:51:02,082 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:02 +0000 (0:00:00.022)       0:01:08.100 ********** 
2026-03-13 14:51:02,645 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:02,651 p=37634 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace] ***
2026-03-13 14:51:02,651 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:02 +0000 (0:00:00.569)       0:01:08.669 ********** 
2026-03-13 14:51:02,669 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-query-frontend-http is running."
}
2026-03-13 14:51:02,675 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "openstack-logging"] ***************************
2026-03-13 14:51:02,675 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:02 +0000 (0:00:00.023)       0:01:08.693 ********** 
2026-03-13 14:51:03,210 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:03,216 p=37634 u=zuul n=ansible | TASK [common : TEST Verify openstack-logging service is running in openshift-logging namespace] ***
2026-03-13 14:51:03,216 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:03 +0000 (0:00:00.541)       0:01:09.234 ********** 
2026-03-13 14:51:03,233 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service openstack-logging is running."
}
2026-03-13 14:51:03,237 p=37634 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-13 14:51:03,237 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:03 +0000 (0:00:00.020)       0:01:09.255 ********** 
2026-03-13 14:51:03,252 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:03,256 p=37634 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-13 14:51:03,257 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:03 +0000 (0:00:00.019)       0:01:09.275 ********** 
2026-03-13 14:51:03,890 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:03,896 p=37634 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-13 14:51:03,896 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:03 +0000 (0:00:00.639)       0:01:09.914 ********** 
2026-03-13 14:51:03,921 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/manifest_tests.yml for controller => (item={'name': 'loki-operator', 'expected_number': 2})
2026-03-13 14:51:03,940 p=37634 u=zuul n=ansible | TASK [common : TEST Get loki-operator 2 packagemanifest] ***********************
2026-03-13 14:51:03,940 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:03 +0000 (0:00:00.044)       0:01:09.958 ********** 
2026-03-13 14:51:03,992 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "Expected 2 and found 2\n"
}
2026-03-13 14:51:03,996 p=37634 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-13 14:51:03,996 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:03 +0000 (0:00:00.056)       0:01:10.015 ********** 
2026-03-13 14:51:04,009 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:04,013 p=37634 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-13 14:51:04,013 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:04 +0000 (0:00:00.017)       0:01:10.032 ********** 
2026-03-13 14:51:04,027 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:04,031 p=37634 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-13 14:51:04,031 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:04 +0000 (0:00:00.017)       0:01:10.049 ********** 
2026-03-13 14:51:04,045 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:04,061 p=37634 u=zuul n=ansible | PLAY [Verify logging pods are running in openstack] ****************************
2026-03-13 14:51:04,069 p=37634 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-13 14:51:04,069 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:04 +0000 (0:00:00.038)       0:01:10.088 ********** 
2026-03-13 14:51:04,093 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstackclient)
2026-03-13 14:51:04,098 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:51:04,099 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:04 +0000 (0:00:00.029)       0:01:10.117 ********** 
2026-03-13 14:51:04,633 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:04,638 p=37634 u=zuul n=ansible | TASK [common : TEST Check openstackclient pod is Running in openstack namespace] ***
2026-03-13 14:51:04,638 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:04 +0000 (0:00:00.539)       0:01:10.656 ********** 
2026-03-13 14:51:05,137 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:05,142 p=37634 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-13 14:51:05,142 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.503)       0:01:11.160 ********** 
2026-03-13 14:51:05,157 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:05,161 p=37634 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-13 14:51:05,161 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.019)       0:01:11.179 ********** 
2026-03-13 14:51:05,176 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:05,181 p=37634 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-13 14:51:05,181 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.019)       0:01:11.199 ********** 
2026-03-13 14:51:05,197 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:05,202 p=37634 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-13 14:51:05,202 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.020)       0:01:11.220 ********** 
2026-03-13 14:51:05,218 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:05,222 p=37634 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-13 14:51:05,222 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.020)       0:01:11.241 ********** 
2026-03-13 14:51:05,240 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:05,244 p=37634 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-13 14:51:05,244 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.021)       0:01:11.262 ********** 
2026-03-13 14:51:05,258 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:05,263 p=37634 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-13 14:51:05,263 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.018)       0:01:11.281 ********** 
2026-03-13 14:51:05,279 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:05,283 p=37634 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-13 14:51:05,283 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.020)       0:01:11.301 ********** 
2026-03-13 14:51:05,300 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:05,304 p=37634 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-13 14:51:05,304 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.020)       0:01:11.322 ********** 
2026-03-13 14:51:05,319 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:05,323 p=37634 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-13 14:51:05,324 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.019)       0:01:11.342 ********** 
2026-03-13 14:51:05,340 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:05,358 p=37634 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-operators-redhat] ***********
2026-03-13 14:51:05,368 p=37634 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-13 14:51:05,369 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.045)       0:01:11.387 ********** 
2026-03-13 14:51:05,400 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=loki-operator-controller-manager)
2026-03-13 14:51:05,405 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:51:05,406 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.036)       0:01:11.424 ********** 
2026-03-13 14:51:05,968 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:05,975 p=37634 u=zuul n=ansible | TASK [common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace] ***
2026-03-13 14:51:05,975 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:05 +0000 (0:00:00.569)       0:01:11.993 ********** 
2026-03-13 14:51:06,591 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:06,596 p=37634 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-13 14:51:06,596 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.620)       0:01:12.614 ********** 
2026-03-13 14:51:06,618 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:06,623 p=37634 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-13 14:51:06,623 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.027)       0:01:12.641 ********** 
2026-03-13 14:51:06,645 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:06,649 p=37634 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-13 14:51:06,649 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.025)       0:01:12.667 ********** 
2026-03-13 14:51:06,669 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:06,673 p=37634 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-13 14:51:06,673 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.024)       0:01:12.692 ********** 
2026-03-13 14:51:06,697 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:06,701 p=37634 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-13 14:51:06,702 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.028)       0:01:12.720 ********** 
2026-03-13 14:51:06,723 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:06,728 p=37634 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-13 14:51:06,728 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.026)       0:01:12.746 ********** 
2026-03-13 14:51:06,751 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:06,756 p=37634 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-13 14:51:06,756 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.027)       0:01:12.774 ********** 
2026-03-13 14:51:06,781 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:06,785 p=37634 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-13 14:51:06,785 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.028)       0:01:12.803 ********** 
2026-03-13 14:51:06,808 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:06,812 p=37634 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-13 14:51:06,812 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.026)       0:01:12.830 ********** 
2026-03-13 14:51:06,836 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:06,839 p=37634 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-13 14:51:06,840 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.027)       0:01:12.858 ********** 
2026-03-13 14:51:06,860 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:06,873 p=37634 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-logging] ********************
2026-03-13 14:51:06,881 p=37634 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-13 14:51:06,882 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.042)       0:01:12.900 ********** 
2026-03-13 14:51:06,969 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=cluster-logging-operator)
2026-03-13 14:51:06,971 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-compactor)
2026-03-13 14:51:06,974 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-distributor)
2026-03-13 14:51:06,977 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-index-gateway)
2026-03-13 14:51:06,980 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-ingester)
2026-03-13 14:51:06,982 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-querier)
2026-03-13 14:51:06,985 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-query-frontend)
2026-03-13 14:51:06,988 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=collector)
2026-03-13 14:51:06,996 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:51:06,996 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:06 +0000 (0:00:00.114)       0:01:13.014 ********** 
2026-03-13 14:51:07,643 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:07,650 p=37634 u=zuul n=ansible | TASK [common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace] ***
2026-03-13 14:51:07,651 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:07 +0000 (0:00:00.654)       0:01:13.669 ********** 
2026-03-13 14:51:08,266 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:08,271 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:51:08,271 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:08 +0000 (0:00:00.620)       0:01:14.289 ********** 
2026-03-13 14:51:08,926 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:08,931 p=37634 u=zuul n=ansible | TASK [common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace] ***
2026-03-13 14:51:08,932 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:08 +0000 (0:00:00.660)       0:01:14.950 ********** 
2026-03-13 14:51:09,526 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:09,534 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:51:09,534 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:09 +0000 (0:00:00.602)       0:01:15.552 ********** 
2026-03-13 14:51:10,181 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:10,187 p=37634 u=zuul n=ansible | TASK [common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace] ***
2026-03-13 14:51:10,187 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:10 +0000 (0:00:00.653)       0:01:16.205 ********** 
2026-03-13 14:51:10,773 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:10,778 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:51:10,778 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:10 +0000 (0:00:00.591)       0:01:16.796 ********** 
2026-03-13 14:51:11,427 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:11,434 p=37634 u=zuul n=ansible | TASK [common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace] ***
2026-03-13 14:51:11,434 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:11 +0000 (0:00:00.655)       0:01:17.452 ********** 
2026-03-13 14:51:12,137 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:12,144 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:51:12,144 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:12 +0000 (0:00:00.710)       0:01:18.162 ********** 
2026-03-13 14:51:12,775 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:12,780 p=37634 u=zuul n=ansible | TASK [common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace] ***
2026-03-13 14:51:12,780 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:12 +0000 (0:00:00.636)       0:01:18.798 ********** 
2026-03-13 14:51:13,246 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:13,251 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:51:13,251 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:13 +0000 (0:00:00.470)       0:01:19.269 ********** 
2026-03-13 14:51:13,821 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:13,826 p=37634 u=zuul n=ansible | TASK [common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace] ***
2026-03-13 14:51:13,826 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:13 +0000 (0:00:00.575)       0:01:19.845 ********** 
2026-03-13 14:51:14,343 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:14,349 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:51:14,349 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:14 +0000 (0:00:00.522)       0:01:20.367 ********** 
2026-03-13 14:51:14,932 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:14,936 p=37634 u=zuul n=ansible | TASK [common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace] ***
2026-03-13 14:51:14,937 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:14 +0000 (0:00:00.587)       0:01:20.955 ********** 
2026-03-13 14:51:15,449 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:15,453 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:51:15,453 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:15 +0000 (0:00:00.516)       0:01:21.472 ********** 
2026-03-13 14:51:15,936 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:15,940 p=37634 u=zuul n=ansible | TASK [common : TEST Check collector pod is Running in openshift-logging namespace] ***
2026-03-13 14:51:15,940 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:15 +0000 (0:00:00.486)       0:01:21.958 ********** 
2026-03-13 14:51:16,419 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:16,423 p=37634 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-13 14:51:16,423 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.482)       0:01:22.441 ********** 
2026-03-13 14:51:16,441 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:16,445 p=37634 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-13 14:51:16,445 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.021)       0:01:22.463 ********** 
2026-03-13 14:51:16,462 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:16,466 p=37634 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-13 14:51:16,466 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.020)       0:01:22.484 ********** 
2026-03-13 14:51:16,481 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:16,485 p=37634 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-13 14:51:16,485 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.019)       0:01:22.503 ********** 
2026-03-13 14:51:16,501 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:16,504 p=37634 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-13 14:51:16,504 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.019)       0:01:22.522 ********** 
2026-03-13 14:51:16,520 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:16,524 p=37634 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-13 14:51:16,524 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.019)       0:01:22.542 ********** 
2026-03-13 14:51:16,542 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:16,546 p=37634 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-13 14:51:16,546 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.021)       0:01:22.564 ********** 
2026-03-13 14:51:16,565 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:16,568 p=37634 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-13 14:51:16,568 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.022)       0:01:22.586 ********** 
2026-03-13 14:51:16,587 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:16,591 p=37634 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-13 14:51:16,591 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.022)       0:01:22.609 ********** 
2026-03-13 14:51:16,607 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:16,610 p=37634 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-13 14:51:16,610 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.019)       0:01:22.628 ********** 
2026-03-13 14:51:16,626 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:16,638 p=37634 u=zuul n=ansible | PLAY [Verify logging pods are running in minio-dev] ****************************
2026-03-13 14:51:16,645 p=37634 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-13 14:51:16,646 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.035)       0:01:22.664 ********** 
2026-03-13 14:51:16,672 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=minio)
2026-03-13 14:51:16,678 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-13 14:51:16,679 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:16 +0000 (0:00:00.032)       0:01:22.697 ********** 
2026-03-13 14:51:17,214 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:17,219 p=37634 u=zuul n=ansible | TASK [common : TEST Check minio pod is Running in minio-dev namespace] *********
2026-03-13 14:51:17,219 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:17 +0000 (0:00:00.540)       0:01:23.237 ********** 
2026-03-13 14:51:17,782 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:17,785 p=37634 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-13 14:51:17,785 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:17 +0000 (0:00:00.566)       0:01:23.804 ********** 
2026-03-13 14:51:17,805 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:17,808 p=37634 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-13 14:51:17,808 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:17 +0000 (0:00:00.022)       0:01:23.826 ********** 
2026-03-13 14:51:17,828 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:17,832 p=37634 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-13 14:51:17,832 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:17 +0000 (0:00:00.023)       0:01:23.850 ********** 
2026-03-13 14:51:17,854 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:17,858 p=37634 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-13 14:51:17,858 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:17 +0000 (0:00:00.025)       0:01:23.876 ********** 
2026-03-13 14:51:17,874 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:17,877 p=37634 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-13 14:51:17,877 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:17 +0000 (0:00:00.019)       0:01:23.896 ********** 
2026-03-13 14:51:17,895 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:17,898 p=37634 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-13 14:51:17,898 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:17 +0000 (0:00:00.020)       0:01:23.916 ********** 
2026-03-13 14:51:17,914 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:17,918 p=37634 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-13 14:51:17,918 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:17 +0000 (0:00:00.019)       0:01:23.936 ********** 
2026-03-13 14:51:17,935 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:17,939 p=37634 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-13 14:51:17,939 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:17 +0000 (0:00:00.021)       0:01:23.957 ********** 
2026-03-13 14:51:17,958 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:17,962 p=37634 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-13 14:51:17,962 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:17 +0000 (0:00:00.022)       0:01:23.980 ********** 
2026-03-13 14:51:17,980 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:17,985 p=37634 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-13 14:51:17,985 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:17 +0000 (0:00:00.022)       0:01:24.003 ********** 
2026-03-13 14:51:18,003 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:18,015 p=37634 u=zuul n=ansible | PLAY [Verify logging pods have complete status in openstack] *******************
2026-03-13 14:51:18,023 p=37634 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-13 14:51:18,023 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:18 +0000 (0:00:00.038)       0:01:24.041 ********** 
2026-03-13 14:51:18,127 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=bootstrap-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,129 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-network-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,132 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-os-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,135 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-certs-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,137 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-os-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,140 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=libvirt-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,142 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,145 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=neutron-metadata-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,148 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ovn-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,151 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=reboot-os-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,154 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=run-os-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,157 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ssh-known-hosts-edpm-deployment)
2026-03-13 14:51:18,159 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,162 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=validate-network-edpm-deployment-openstack-edpm-ipam)
2026-03-13 14:51:18,167 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:18,168 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:18 +0000 (0:00:00.144)       0:01:24.186 ********** 
2026-03-13 14:51:18,800 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:18,805 p=37634 u=zuul n=ansible | TASK [common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:18,805 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:18 +0000 (0:00:00.637)       0:01:24.823 ********** 
2026-03-13 14:51:19,372 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:19,377 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:19,377 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:19 +0000 (0:00:00.572)       0:01:25.396 ********** 
2026-03-13 14:51:19,956 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:19,961 p=37634 u=zuul n=ansible | TASK [common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:19,961 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:19 +0000 (0:00:00.583)       0:01:25.979 ********** 
2026-03-13 14:51:20,515 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:20,521 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:20,522 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:20 +0000 (0:00:00.560)       0:01:26.540 ********** 
2026-03-13 14:51:21,123 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:21,128 p=37634 u=zuul n=ansible | TASK [common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:21,128 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:21 +0000 (0:00:00.606)       0:01:27.147 ********** 
2026-03-13 14:51:21,617 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:21,622 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:21,622 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:21 +0000 (0:00:00.493)       0:01:27.640 ********** 
2026-03-13 14:51:22,235 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:22,240 p=37634 u=zuul n=ansible | TASK [common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:22,240 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:22 +0000 (0:00:00.618)       0:01:28.258 ********** 
2026-03-13 14:51:22,788 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:22,793 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:22,793 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:22 +0000 (0:00:00.552)       0:01:28.811 ********** 
2026-03-13 14:51:23,349 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:23,355 p=37634 u=zuul n=ansible | TASK [common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:23,355 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:23 +0000 (0:00:00.562)       0:01:29.374 ********** 
2026-03-13 14:51:23,895 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:23,900 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:23,900 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:23 +0000 (0:00:00.544)       0:01:29.918 ********** 
2026-03-13 14:51:24,488 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:24,493 p=37634 u=zuul n=ansible | TASK [common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:24,494 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:24 +0000 (0:00:00.593)       0:01:30.512 ********** 
2026-03-13 14:51:25,056 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:25,061 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:25,061 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:25 +0000 (0:00:00.567)       0:01:31.079 ********** 
2026-03-13 14:51:25,663 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:25,668 p=37634 u=zuul n=ansible | TASK [common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:25,668 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:25 +0000 (0:00:00.607)       0:01:31.686 ********** 
2026-03-13 14:51:26,243 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:26,248 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:26,248 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:26 +0000 (0:00:00.579)       0:01:32.266 ********** 
2026-03-13 14:51:26,837 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:26,841 p=37634 u=zuul n=ansible | TASK [common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:26,842 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:26 +0000 (0:00:00.593)       0:01:32.860 ********** 
2026-03-13 14:51:27,352 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:27,356 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:27,356 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:27 +0000 (0:00:00.514)       0:01:33.375 ********** 
2026-03-13 14:51:27,903 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:27,908 p=37634 u=zuul n=ansible | TASK [common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:27,908 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:27 +0000 (0:00:00.551)       0:01:33.926 ********** 
2026-03-13 14:51:28,449 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:28,454 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:28,454 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:28 +0000 (0:00:00.546)       0:01:34.472 ********** 
2026-03-13 14:51:29,046 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:29,052 p=37634 u=zuul n=ansible | TASK [common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:29,052 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:29 +0000 (0:00:00.597)       0:01:35.070 ********** 
2026-03-13 14:51:29,566 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:29,572 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:29,572 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:29 +0000 (0:00:00.519)       0:01:35.590 ********** 
2026-03-13 14:51:30,148 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:30,154 p=37634 u=zuul n=ansible | TASK [common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:30,154 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:30 +0000 (0:00:00.582)       0:01:36.172 ********** 
2026-03-13 14:51:30,686 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:30,692 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:30,692 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:30 +0000 (0:00:00.537)       0:01:36.710 ********** 
2026-03-13 14:51:31,286 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:31,291 p=37634 u=zuul n=ansible | TASK [common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace] ***
2026-03-13 14:51:31,292 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:31 +0000 (0:00:00.599)       0:01:37.310 ********** 
2026-03-13 14:51:31,835 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:31,842 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:31,842 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:31 +0000 (0:00:00.550)       0:01:37.860 ********** 
2026-03-13 14:51:32,482 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:32,488 p=37634 u=zuul n=ansible | TASK [common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:32,488 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:32 +0000 (0:00:00.646)       0:01:38.506 ********** 
2026-03-13 14:51:33,041 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:33,046 p=37634 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-13 14:51:33,046 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:33 +0000 (0:00:00.558)       0:01:39.065 ********** 
2026-03-13 14:51:33,686 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:33,693 p=37634 u=zuul n=ansible | TASK [common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-13 14:51:33,693 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:33 +0000 (0:00:00.646)       0:01:39.711 ********** 
2026-03-13 14:51:34,244 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:34,247 p=37634 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-13 14:51:34,248 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.554)       0:01:40.266 ********** 
2026-03-13 14:51:34,268 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,271 p=37634 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-13 14:51:34,271 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.023)       0:01:40.290 ********** 
2026-03-13 14:51:34,289 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,293 p=37634 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-13 14:51:34,293 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.021)       0:01:40.311 ********** 
2026-03-13 14:51:34,311 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,315 p=37634 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-13 14:51:34,316 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.022)       0:01:40.334 ********** 
2026-03-13 14:51:34,336 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,339 p=37634 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-13 14:51:34,339 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.023)       0:01:40.357 ********** 
2026-03-13 14:51:34,356 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,359 p=37634 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-13 14:51:34,359 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.020)       0:01:40.378 ********** 
2026-03-13 14:51:34,375 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,379 p=37634 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-13 14:51:34,379 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.019)       0:01:40.397 ********** 
2026-03-13 14:51:34,395 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,399 p=37634 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-13 14:51:34,399 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.019)       0:01:40.417 ********** 
2026-03-13 14:51:34,414 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,418 p=37634 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-13 14:51:34,418 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.018)       0:01:40.436 ********** 
2026-03-13 14:51:34,433 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,437 p=37634 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-13 14:51:34,437 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.019)       0:01:40.455 ********** 
2026-03-13 14:51:34,453 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,465 p=37634 u=zuul n=ansible | PLAY [Verify the crds exist] ***************************************************
2026-03-13 14:51:34,472 p=37634 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-13 14:51:34,472 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.035)       0:01:40.490 ********** 
2026-03-13 14:51:34,489 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,493 p=37634 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-13 14:51:34,493 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.020)       0:01:40.511 ********** 
2026-03-13 14:51:34,509 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,513 p=37634 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-13 14:51:34,513 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.019)       0:01:40.531 ********** 
2026-03-13 14:51:34,529 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,534 p=37634 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-13 14:51:34,534 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.021)       0:01:40.552 ********** 
2026-03-13 14:51:34,551 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:34,555 p=37634 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-13 14:51:34,555 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.020)       0:01:40.573 ********** 
2026-03-13 14:51:34,597 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-internal)
2026-03-13 14:51:34,599 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-metadata-internal)
2026-03-13 14:51:34,600 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-novncproxy-cell1-public)
2026-03-13 14:51:34,602 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-public)
2026-03-13 14:51:34,607 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "nova-internal"] *******************************
2026-03-13 14:51:34,607 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:34 +0000 (0:00:00.052)       0:01:40.625 ********** 
2026-03-13 14:51:35,102 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:35,107 p=37634 u=zuul n=ansible | TASK [common : TEST Verify nova-internal service is running in openstack namespace] ***
2026-03-13 14:51:35,108 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:35 +0000 (0:00:00.500)       0:01:41.126 ********** 
2026-03-13 14:51:35,123 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service nova-internal is running."
}
2026-03-13 14:51:35,128 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "nova-metadata-internal"] **********************
2026-03-13 14:51:35,128 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:35 +0000 (0:00:00.020)       0:01:41.146 ********** 
2026-03-13 14:51:35,632 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:35,638 p=37634 u=zuul n=ansible | TASK [common : TEST Verify nova-metadata-internal service is running in openstack namespace] ***
2026-03-13 14:51:35,638 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:35 +0000 (0:00:00.509)       0:01:41.656 ********** 
2026-03-13 14:51:35,656 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service nova-metadata-internal is running."
}
2026-03-13 14:51:35,662 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "nova-novncproxy-cell1-public"] ****************
2026-03-13 14:51:35,662 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:35 +0000 (0:00:00.023)       0:01:41.680 ********** 
2026-03-13 14:51:36,160 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:36,165 p=37634 u=zuul n=ansible | TASK [common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace] ***
2026-03-13 14:51:36,165 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:36 +0000 (0:00:00.502)       0:01:42.183 ********** 
2026-03-13 14:51:36,182 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service nova-novncproxy-cell1-public is running."
}
2026-03-13 14:51:36,187 p=37634 u=zuul n=ansible | TASK [common : Verify Service - "nova-public"] *********************************
2026-03-13 14:51:36,188 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:36 +0000 (0:00:00.022)       0:01:42.206 ********** 
2026-03-13 14:51:36,704 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:36,710 p=37634 u=zuul n=ansible | TASK [common : TEST Verify nova-public service is running in openstack namespace] ***
2026-03-13 14:51:36,710 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:36 +0000 (0:00:00.522)       0:01:42.728 ********** 
2026-03-13 14:51:36,728 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service nova-public is running."
}
2026-03-13 14:51:36,732 p=37634 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-13 14:51:36,733 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:36 +0000 (0:00:00.022)       0:01:42.751 ********** 
2026-03-13 14:51:36,748 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:36,752 p=37634 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-13 14:51:36,753 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:36 +0000 (0:00:00.019)       0:01:42.771 ********** 
2026-03-13 14:51:36,768 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:36,774 p=37634 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-13 14:51:36,774 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:36 +0000 (0:00:00.021)       0:01:42.792 ********** 
2026-03-13 14:51:36,790 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:36,795 p=37634 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-13 14:51:36,795 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:36 +0000 (0:00:00.021)       0:01:42.813 ********** 
2026-03-13 14:51:36,843 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=alertingrules.loki.grafana.com)
2026-03-13 14:51:36,845 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=lokistacks.loki.grafana.com)
2026-03-13 14:51:36,847 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=recordingrules.loki.grafana.com)
2026-03-13 14:51:36,849 p=37634 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=rulerconfigs.loki.grafana.com)
2026-03-13 14:51:36,855 p=37634 u=zuul n=ansible | TASK [common : Verify CRD "alertingrules.loki.grafana.com"] ********************
2026-03-13 14:51:36,856 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:36 +0000 (0:00:00.060)       0:01:42.874 ********** 
2026-03-13 14:51:37,348 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:37,353 p=37634 u=zuul n=ansible | TASK [common : TEST Verify CRD alertingrules.loki.grafana.com is found] ********
2026-03-13 14:51:37,353 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:37 +0000 (0:00:00.497)       0:01:43.371 ********** 
2026-03-13 14:51:37,369 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "CRD alertingrules.loki.grafana.com is found."
}
2026-03-13 14:51:37,373 p=37634 u=zuul n=ansible | TASK [common : Verify CRD "lokistacks.loki.grafana.com"] ***********************
2026-03-13 14:51:37,373 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:37 +0000 (0:00:00.020)       0:01:43.391 ********** 
2026-03-13 14:51:37,862 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:37,867 p=37634 u=zuul n=ansible | TASK [common : TEST Verify CRD lokistacks.loki.grafana.com is found] ***********
2026-03-13 14:51:37,867 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:37 +0000 (0:00:00.493)       0:01:43.885 ********** 
2026-03-13 14:51:37,883 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "CRD lokistacks.loki.grafana.com is found."
}
2026-03-13 14:51:37,888 p=37634 u=zuul n=ansible | TASK [common : Verify CRD "recordingrules.loki.grafana.com"] *******************
2026-03-13 14:51:37,888 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:37 +0000 (0:00:00.021)       0:01:43.906 ********** 
2026-03-13 14:51:38,399 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:38,404 p=37634 u=zuul n=ansible | TASK [common : TEST Verify CRD recordingrules.loki.grafana.com is found] *******
2026-03-13 14:51:38,404 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:38 +0000 (0:00:00.515)       0:01:44.422 ********** 
2026-03-13 14:51:38,423 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "CRD recordingrules.loki.grafana.com is found."
}
2026-03-13 14:51:38,428 p=37634 u=zuul n=ansible | TASK [common : Verify CRD "rulerconfigs.loki.grafana.com"] *********************
2026-03-13 14:51:38,428 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:38 +0000 (0:00:00.024)       0:01:44.446 ********** 
2026-03-13 14:51:38,943 p=37634 u=zuul n=ansible | ok: [controller]
2026-03-13 14:51:38,949 p=37634 u=zuul n=ansible | TASK [common : TEST Verify CRD rulerconfigs.loki.grafana.com is found] *********
2026-03-13 14:51:38,949 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:38 +0000 (0:00:00.520)       0:01:44.967 ********** 
2026-03-13 14:51:38,971 p=37634 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "CRD rulerconfigs.loki.grafana.com is found."
}
2026-03-13 14:51:38,975 p=37634 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-13 14:51:38,976 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:38 +0000 (0:00:00.026)       0:01:44.994 ********** 
2026-03-13 14:51:38,990 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:38,994 p=37634 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-13 14:51:38,994 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:38 +0000 (0:00:00.018)       0:01:45.012 ********** 
2026-03-13 14:51:39,008 p=37634 u=zuul n=ansible | skipping: [controller]
2026-03-13 14:51:39,019 p=37634 u=zuul n=ansible | PLAY RECAP *********************************************************************
2026-03-13 14:51:39,019 p=37634 u=zuul n=ansible | compute-0                  : ok=19   changed=0    unreachable=0    failed=0    skipped=24   rescued=0    ignored=0   
2026-03-13 14:51:39,019 p=37634 u=zuul n=ansible | controller                 : ok=219  changed=0    unreachable=0    failed=0    skipped=63   rescued=0    ignored=0   
2026-03-13 14:51:39,080 p=37634 u=zuul n=ansible | Friday 13 March 2026  14:51:39 +0000 (0:00:00.086)       0:01:45.099 ********** 
2026-03-13 14:51:39,080 p=37634 u=zuul n=ansible | =============================================================================== 
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'internal']" -------------- 3.69s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'public']" ------------- 3.10s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'public']" ---------------- 2.99s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'internal']" ------- 2.78s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'public']" ---------- 2.60s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'internal']" --------- 2.57s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'public']" ----------- 2.56s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'public']" --------- 2.55s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'internal']" ------ 2.53s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'public']" ----------- 2.52s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'internal']" -------- 2.51s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'public']" ---------------- 2.50s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'internal']" ----------- 2.49s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 2.48s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'internal']" -------------- 2.46s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'internal']" --------- 2.45s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute
RHOSO-XXX
 ----------- 2.40s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'public']" -------- 2.34s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 1.81s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute
RHOSO-XXX
 --- 0.93s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.88s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.79s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.78s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf" -------- 0.75s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace
 --- 0.71s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.66s
2026-03-13 14:51:39,081 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.66s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.65s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.65s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.65s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.65s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.64s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.64s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.64s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace
 --- 0.62s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace
 --- 0.62s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.62s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace
 --- 0.60s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.60s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace
 --- 0.60s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.60s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.59s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.59s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace
 --- 0.59s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace
 --- 0.59s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Verify Service - "cluster-logging-operator-metrics" ------------ 0.59s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.59s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.58s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.58s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.58s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-grpc" ----------------- 0.58s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.58s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.58s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-http" ------------------- 0.57s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.57s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-http" ------------ 0.57s
2026-03-13 14:51:39,082 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.57s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.57s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-grpc" ------------------- 0.57s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check minio pod is Running in minio-dev namespace
 -------- 0.57s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-gossip-ring" -------------------- 0.57s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.56s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.56s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.56s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.55s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-http" ------------------ 0.55s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.55s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.55s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-grpc" ------------ 0.55s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace
 --- 0.55s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.55s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.54s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-http" ------------- 0.54s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify Service - "openstack-logging" --------------------------- 0.54s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.54s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.54s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Get the openstack-operators project ---------------------------- 0.54s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.54s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Get the openshift project -------------------------------------- 0.54s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify subscription "loki-operator" ---------------------------- 0.53s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-gateway-http" ------------------- 0.53s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace
 --- 0.52s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify Service - "nova-public" --------------------------------- 0.52s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify CRD "rulerconfigs.loki.grafana.com" --------------------- 0.52s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.52s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace
 --- 0.52s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify CRD "recordingrules.loki.grafana.com" ------------------- 0.52s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-http" --------------- 0.52s
2026-03-13 14:51:39,083 p=37634 u=zuul n=ansible | common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.51s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-grpc" ------------- 0.51s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify Service - "nova-metadata-internal" ---------------------- 0.51s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-grpc" ------------------ 0.51s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : TEST Check openstackclient pod is Running in openstack namespace
 --- 0.50s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify Service - "nova-novncproxy-cell1-public" ---------------- 0.50s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-grpc" --------------- 0.50s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify Service - "nova-internal" ------------------------------- 0.50s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Get the openshift-logging project ------------------------------ 0.50s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify CRD "alertingrules.loki.grafana.com" -------------------- 0.50s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify CRD "lokistacks.loki.grafana.com" ----------------------- 0.49s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.49s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-http" ----------------- 0.49s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.49s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Get the openshift-openstack-infra project ---------------------- 0.49s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : TEST Check collector pod is Running in openshift-logging namespace
 --- 0.48s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace
 --- 0.47s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.16s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.14s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.11s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.11s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute
RHOSO-XXX
 ----------- 0.09s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.09s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.08s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : TEST Verify node_exporter container status
 -------------------- 0.08s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.07s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.06s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute
RHOSO-XXX
 --- 0.06s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.06s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : TEST Get loki-operator 2 packagemanifest
 ---------------------- 0.06s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.05s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.05s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists
 --- 0.05s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.05s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : TEST Check that neutron public endpoint exists
 ---------------- 0.05s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : TEST Verify ceilometer_agent_compute container status
 --------- 0.05s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.05s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s
2026-03-13 14:51:39,084 p=37634 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | telemetry_logging : Verify journal entries ------------------------------ 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Check that nova public endpoint exists
 ------------------- 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Check that nova internal endpoint exists
 ----------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Check that glance internal endpoint exists
 --------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Check that placement public endpoint exists
 -------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Check that glance public endpoint exists
 ----------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Check that swift internal endpoint exists
 ---------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Check that cinderv3 internal endpoint exists
 ------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace
 --- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Check that keystone internal endpoint exists
 ------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace
 --- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Check that cinderv3 public endpoint exists
 --------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Verify openshift project exists
 -------------------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : TEST Check that barbican internal endpoint exists
 ------------- 0.03s
2026-03-13 14:51:39,085 p=37634 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace
 --- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Check that swift public endpoint exists
 ------------------ 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace
 --- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify CRD rulerconfigs.loki.grafana.com is found
 -------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace
 --- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace
 --- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace
 --- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Check that placement internal endpoint exists
 ------------ 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace
 --- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Check that barbican public endpoint exists
 --------------- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify openshift-openstack-infra project exists
 ---------- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify openstack-operators project exists
 ---------------- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify CRD recordingrules.loki.grafana.com is found
 ------ 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace
 --- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace
 --- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : TEST Verify nova-metadata-internal service is running in openstack namespace
 --- 0.02s
2026-03-13 14:51:39,086 p=37634 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace
 --- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Check that keystone public endpoint exists
 --------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace
 --- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace
 --- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Verify openshift-logging project exists
 ------------------ 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace
 --- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace
 --- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace
 --- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Verify nova-public service is running in openstack namespace
 --- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Check that neutron internal endpoint exists
 -------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Verify CRD lokistacks.loki.grafana.com is found
 ---------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-13 14:51:39,087 p=37634 u=zuul n=ansible | common : TEST Verify openstack-logging service is running in openshift-logging namespace
 --- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : TEST Verify nova-internal service is running in openstack namespace
 --- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : TEST Verify CRD alertingrules.loki.grafana.com is found
 ------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace
 --- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-13 14:51:39,088 p=37634 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s