2026-03-20 14:15:33,644 p=37687 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace

2026-03-20 14:15:33,644 p=37687 u=zuul n=ansible | PLAY [Verify logging journalctl identifiers] ***********************************
2026-03-20 14:15:33,652 p=37687 u=zuul n=ansible | TASK [Gathering Facts] *********************************************************
2026-03-20 14:15:33,652 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:33 +0000 (0:00:00.011)       0:00:00.011 ********** 
2026-03-20 14:15:36,024 p=37687 u=zuul n=ansible | ok: [compute-0]
2026-03-20 14:15:36,045 p=37687 u=zuul n=ansible | TASK [telemetry_logging : Verify journal entries] ******************************
2026-03-20 14:15:36,045 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:36 +0000 (0:00:02.392)       0:00:02.404 ********** 
2026-03-20 14:15:36,079 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=ceilometer_agent_compute)
2026-03-20 14:15:36,081 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=nova_compute)
2026-03-20 14:15:36,090 p=37687 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute
RHOSO-XXX] ***
2026-03-20 14:15:36,090 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:36 +0000 (0:00:00.044)       0:00:02.448 ********** 
2026-03-20 14:15:37,164 p=37687 u=zuul n=ansible | ok: [compute-0]
2026-03-20 14:15:37,175 p=37687 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute
RHOSO-XXX] ***
2026-03-20 14:15:37,175 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:37 +0000 (0:00:01.085)       0:00:03.534 ********** 
2026-03-20 14:15:37,214 p=37687 u=zuul n=ansible | ok: [compute-0] => {
    "changed": false,
    "msg": "The test passed!"
}
2026-03-20 14:15:37,223 p=37687 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute
RHOSO-XXX] *************
2026-03-20 14:15:37,223 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:37 +0000 (0:00:00.048)       0:00:03.582 ********** 
2026-03-20 14:15:39,667 p=37687 u=zuul n=ansible | ok: [compute-0]
2026-03-20 14:15:39,724 p=37687 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute
RHOSO-XXX] *************
2026-03-20 14:15:39,724 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:39 +0000 (0:00:02.500)       0:00:06.083 ********** 
2026-03-20 14:15:39,799 p=37687 u=zuul n=ansible | ok: [compute-0] => {
    "changed": false,
    "msg": "The test passed!"
}
2026-03-20 14:15:39,817 p=37687 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-20 14:15:39,817 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:39 +0000 (0:00:00.093)       0:00:06.176 ********** 
2026-03-20 14:15:39,833 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:39,841 p=37687 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-20 14:15:39,841 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:39 +0000 (0:00:00.023)       0:00:06.200 ********** 
2026-03-20 14:15:39,857 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:39,865 p=37687 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-20 14:15:39,865 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:39 +0000 (0:00:00.024)       0:00:06.224 ********** 
2026-03-20 14:15:39,882 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:39,891 p=37687 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-20 14:15:39,891 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:39 +0000 (0:00:00.026)       0:00:06.250 ********** 
2026-03-20 14:15:39,909 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:39,916 p=37687 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-20 14:15:39,916 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:39 +0000 (0:00:00.024)       0:00:06.275 ********** 
2026-03-20 14:15:39,934 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:39,941 p=37687 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-20 14:15:39,941 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:39 +0000 (0:00:00.024)       0:00:06.300 ********** 
2026-03-20 14:15:39,970 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/file_tests.yml for compute-0 => (item=/etc/rsyslog.d/10-telemetry.conf)
2026-03-20 14:15:39,979 p=37687 u=zuul n=ansible | TASK [common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf"] ********
2026-03-20 14:15:39,979 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:39 +0000 (0:00:00.038)       0:00:06.338 ********** 
2026-03-20 14:15:40,826 p=37687 u=zuul n=ansible | ok: [compute-0]
2026-03-20 14:15:40,841 p=37687 u=zuul n=ansible | TASK [common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists] ***
2026-03-20 14:15:40,841 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:40 +0000 (0:00:00.862)       0:00:07.200 ********** 
2026-03-20 14:15:40,882 p=37687 u=zuul n=ansible | ok: [compute-0] => {
    "changed": false,
    "msg": "The test passed"
}
2026-03-20 14:15:40,890 p=37687 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-20 14:15:40,890 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:40 +0000 (0:00:00.049)       0:00:07.249 ********** 
2026-03-20 14:15:40,906 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:40,915 p=37687 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-20 14:15:40,915 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:40 +0000 (0:00:00.024)       0:00:07.273 ********** 
2026-03-20 14:15:40,931 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:40,938 p=37687 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-20 14:15:40,938 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:40 +0000 (0:00:00.023)       0:00:07.297 ********** 
2026-03-20 14:15:40,955 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:40,962 p=37687 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-20 14:15:40,963 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:40 +0000 (0:00:00.024)       0:00:07.321 ********** 
2026-03-20 14:15:40,979 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:40,986 p=37687 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-20 14:15:40,986 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:40 +0000 (0:00:00.023)       0:00:07.345 ********** 
2026-03-20 14:15:41,007 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:41,039 p=37687 u=zuul n=ansible | PLAY [Run container tests which require root on compute nodes] *****************
2026-03-20 14:15:41,046 p=37687 u=zuul n=ansible | TASK [Gathering Facts] *********************************************************
2026-03-20 14:15:41,046 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:41 +0000 (0:00:00.059)       0:00:07.405 ********** 
2026-03-20 14:15:42,959 p=37687 u=zuul n=ansible | ok: [compute-0]
2026-03-20 14:15:42,979 p=37687 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-20 14:15:42,979 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:42 +0000 (0:00:01.933)       0:00:09.338 ********** 
2026-03-20 14:15:42,996 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:43,003 p=37687 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-20 14:15:43,004 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:43 +0000 (0:00:00.024)       0:00:09.362 ********** 
2026-03-20 14:15:43,017 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:43,025 p=37687 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-20 14:15:43,026 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:43 +0000 (0:00:00.022)       0:00:09.384 ********** 
2026-03-20 14:15:43,040 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:43,048 p=37687 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-20 14:15:43,048 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:43 +0000 (0:00:00.022)       0:00:09.406 ********** 
2026-03-20 14:15:43,062 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:43,070 p=37687 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-20 14:15:43,070 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:43 +0000 (0:00:00.022)       0:00:09.429 ********** 
2026-03-20 14:15:43,087 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:43,094 p=37687 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-20 14:15:43,094 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:43 +0000 (0:00:00.023)       0:00:09.453 ********** 
2026-03-20 14:15:43,108 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:43,114 p=37687 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-20 14:15:43,114 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:43 +0000 (0:00:00.020)       0:00:09.473 ********** 
2026-03-20 14:15:43,127 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:43,134 p=37687 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-20 14:15:43,135 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:43 +0000 (0:00:00.020)       0:00:09.493 ********** 
2026-03-20 14:15:43,149 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:43,156 p=37687 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-20 14:15:43,156 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:43 +0000 (0:00:00.021)       0:00:09.515 ********** 
2026-03-20 14:15:43,171 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:43,179 p=37687 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-20 14:15:43,179 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:43 +0000 (0:00:00.023)       0:00:09.538 ********** 
2026-03-20 14:15:43,197 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:43,205 p=37687 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-20 14:15:43,205 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:43 +0000 (0:00:00.025)       0:00:09.564 ********** 
2026-03-20 14:15:43,241 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=ceilometer_agent_compute)
2026-03-20 14:15:43,245 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=node_exporter)
2026-03-20 14:15:43,255 p=37687 u=zuul n=ansible | TASK [common : Get container status] *******************************************
2026-03-20 14:15:43,255 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:43 +0000 (0:00:00.050)       0:00:09.614 ********** 
2026-03-20 14:15:44,085 p=37687 u=zuul n=ansible | ok: [compute-0]
2026-03-20 14:15:44,095 p=37687 u=zuul n=ansible | TASK [common : Show the container name and status] *****************************
2026-03-20 14:15:44,096 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:44 +0000 (0:00:00.840)       0:00:10.454 ********** 
2026-03-20 14:15:44,113 p=37687 u=zuul n=ansible | ok: [compute-0] => {
    "container_status.stdout": "ceilometer_agent_compute Up 4 minutes (healthy)"
}
2026-03-20 14:15:44,121 p=37687 u=zuul n=ansible | TASK [common : Show the containers] ********************************************
2026-03-20 14:15:44,121 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:44 +0000 (0:00:00.025)       0:00:10.480 ********** 
2026-03-20 14:15:44,143 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:44,152 p=37687 u=zuul n=ansible | TASK [common : Show the output of container list] ******************************
2026-03-20 14:15:44,152 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:44 +0000 (0:00:00.030)       0:00:10.511 ********** 
2026-03-20 14:15:44,176 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:44,186 p=37687 u=zuul n=ansible | TASK [common : TEST Verify ceilometer_agent_compute container status] **********
2026-03-20 14:15:44,187 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:44 +0000 (0:00:00.034)       0:00:10.545 ********** 
2026-03-20 14:15:44,220 p=37687 u=zuul n=ansible | ok: [compute-0] => {
    "changed": false,
    "msg": "Container 'ceilometer_agent_compute' is in 'healthy' status."
}
2026-03-20 14:15:44,229 p=37687 u=zuul n=ansible | TASK [common : Get container status] *******************************************
2026-03-20 14:15:44,229 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:44 +0000 (0:00:00.042)       0:00:10.588 ********** 
2026-03-20 14:15:45,407 p=37687 u=zuul n=ansible | ok: [compute-0]
2026-03-20 14:15:45,415 p=37687 u=zuul n=ansible | TASK [common : Show the container name and status] *****************************
2026-03-20 14:15:45,415 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:45 +0000 (0:00:01.186)       0:00:11.774 ********** 
2026-03-20 14:15:45,434 p=37687 u=zuul n=ansible | ok: [compute-0] => {
    "container_status.stdout": "node_exporter Up 4 minutes (healthy)"
}
2026-03-20 14:15:45,444 p=37687 u=zuul n=ansible | TASK [common : Show the containers] ********************************************
2026-03-20 14:15:45,444 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:45 +0000 (0:00:00.028)       0:00:11.803 ********** 
2026-03-20 14:15:45,468 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:45,478 p=37687 u=zuul n=ansible | TASK [common : Show the output of container list] ******************************
2026-03-20 14:15:45,478 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:45 +0000 (0:00:00.034)       0:00:11.837 ********** 
2026-03-20 14:15:45,504 p=37687 u=zuul n=ansible | skipping: [compute-0]
2026-03-20 14:15:45,513 p=37687 u=zuul n=ansible | TASK [common : TEST Verify node_exporter container status] *********************
2026-03-20 14:15:45,514 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:45 +0000 (0:00:00.035)       0:00:11.872 ********** 
2026-03-20 14:15:45,548 p=37687 u=zuul n=ansible | ok: [compute-0] => {
    "changed": false,
    "msg": "Container 'node_exporter' is in 'healthy' status."
}
2026-03-20 14:15:45,581 p=37687 u=zuul n=ansible | PLAY [Verify logging projects, endpoints, credentials, nodes, pods, services, manifests and subscriptions] ***
2026-03-20 14:15:45,590 p=37687 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-20 14:15:45,590 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:45 +0000 (0:00:00.076)       0:00:11.949 ********** 
2026-03-20 14:15:45,626 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-operator-controller-manager)
2026-03-20 14:15:45,629 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstack-operator-controller-manager)
2026-03-20 14:15:45,639 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:15:45,639 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:45 +0000 (0:00:00.048)       0:00:11.998 ********** 
2026-03-20 14:15:46,494 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:15:46,500 p=37687 u=zuul n=ansible | TASK [common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace] ***
2026-03-20 14:15:46,500 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:46 +0000 (0:00:00.860)       0:00:12.859 ********** 
2026-03-20 14:15:47,028 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:15:47,034 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:15:47,034 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:47 +0000 (0:00:00.534)       0:00:13.393 ********** 
2026-03-20 14:15:47,580 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:15:47,586 p=37687 u=zuul n=ansible | TASK [common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace] ***
2026-03-20 14:15:47,586 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:47 +0000 (0:00:00.551)       0:00:13.945 ********** 
2026-03-20 14:15:48,130 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:15:48,136 p=37687 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-20 14:15:48,136 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:48 +0000 (0:00:00.550)       0:00:14.495 ********** 
2026-03-20 14:15:48,161 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/subscription_tests.yml for controller => (item=loki-operator)
2026-03-20 14:15:48,173 p=37687 u=zuul n=ansible | TASK [common : Verify subscription "loki-operator"] ****************************
2026-03-20 14:15:48,173 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:48 +0000 (0:00:00.037)       0:00:14.532 ********** 
2026-03-20 14:15:48,683 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:15:48,688 p=37687 u=zuul n=ansible | TASK [common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace] ***
2026-03-20 14:15:48,688 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:48 +0000 (0:00:00.515)       0:00:15.047 ********** 
2026-03-20 14:15:48,707 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "subscription loki-operator is found."
}
2026-03-20 14:15:48,712 p=37687 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-20 14:15:48,712 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:48 +0000 (0:00:00.023)       0:00:15.071 ********** 
2026-03-20 14:15:48,798 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'public'])
2026-03-20 14:15:48,801 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'internal'])
2026-03-20 14:15:48,803 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'public'])
2026-03-20 14:15:48,805 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'internal'])
2026-03-20 14:15:48,807 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'public'])
2026-03-20 14:15:48,809 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'internal'])
2026-03-20 14:15:48,811 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'public'])
2026-03-20 14:15:48,813 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'internal'])
2026-03-20 14:15:48,815 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'public'])
2026-03-20 14:15:48,817 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'internal'])
2026-03-20 14:15:48,819 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'public'])
2026-03-20 14:15:48,821 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'internal'])
2026-03-20 14:15:48,823 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'public'])
2026-03-20 14:15:48,825 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'internal'])
2026-03-20 14:15:48,827 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'public'])
2026-03-20 14:15:48,829 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'internal'])
2026-03-20 14:15:48,843 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'public']"] ****************
2026-03-20 14:15:48,843 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:48 +0000 (0:00:00.131)       0:00:15.202 ********** 
2026-03-20 14:15:51,686 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:15:51,692 p=37687 u=zuul n=ansible | TASK [common : TEST Check that nova public endpoint exists] ********************
2026-03-20 14:15:51,692 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:51 +0000 (0:00:02.848)       0:00:18.051 ********** 
2026-03-20 14:15:51,709 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint nova is found."
}
2026-03-20 14:15:51,714 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'internal']"] **************
2026-03-20 14:15:51,714 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:51 +0000 (0:00:00.022)       0:00:18.073 ********** 
2026-03-20 14:15:54,138 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:15:54,145 p=37687 u=zuul n=ansible | TASK [common : TEST Check that nova internal endpoint exists] ******************
2026-03-20 14:15:54,145 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:54 +0000 (0:00:02.430)       0:00:20.504 ********** 
2026-03-20 14:15:54,165 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint nova is found."
}
2026-03-20 14:15:54,172 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'public']"] *********
2026-03-20 14:15:54,172 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:54 +0000 (0:00:00.027)       0:00:20.531 ********** 
2026-03-20 14:15:56,845 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:15:56,851 p=37687 u=zuul n=ansible | TASK [common : TEST Check that placement public endpoint exists] ***************
2026-03-20 14:15:56,851 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:56 +0000 (0:00:02.678)       0:00:23.210 ********** 
2026-03-20 14:15:56,868 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint placement is found."
}
2026-03-20 14:15:56,874 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'internal']"] *******
2026-03-20 14:15:56,874 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:56 +0000 (0:00:00.023)       0:00:23.233 ********** 
2026-03-20 14:15:59,342 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:15:59,348 p=37687 u=zuul n=ansible | TASK [common : TEST Check that placement internal endpoint exists] *************
2026-03-20 14:15:59,348 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:59 +0000 (0:00:02.473)       0:00:25.707 ********** 
2026-03-20 14:15:59,367 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint placement is found."
}
2026-03-20 14:15:59,372 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'public']"] **********
2026-03-20 14:15:59,372 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:15:59 +0000 (0:00:00.023)       0:00:25.731 ********** 
2026-03-20 14:16:01,939 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:01,945 p=37687 u=zuul n=ansible | TASK [common : TEST Check that swift public endpoint exists] *******************
2026-03-20 14:16:01,945 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:01 +0000 (0:00:02.572)       0:00:28.304 ********** 
2026-03-20 14:16:01,961 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint swift is found."
}
2026-03-20 14:16:01,967 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'internal']"] ********
2026-03-20 14:16:01,967 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:01 +0000 (0:00:00.021)       0:00:28.325 ********** 
2026-03-20 14:16:04,611 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:04,618 p=37687 u=zuul n=ansible | TASK [common : TEST Check that swift internal endpoint exists] *****************
2026-03-20 14:16:04,618 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:04 +0000 (0:00:02.651)       0:00:30.977 ********** 
2026-03-20 14:16:04,634 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint swift is found."
}
2026-03-20 14:16:04,639 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'public']"] ***********
2026-03-20 14:16:04,639 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:04 +0000 (0:00:00.020)       0:00:30.998 ********** 
2026-03-20 14:16:07,214 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:07,220 p=37687 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 public endpoint exists] ****************
2026-03-20 14:16:07,221 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:07 +0000 (0:00:02.581)       0:00:33.579 ********** 
2026-03-20 14:16:07,239 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint cinderv3 is found."
}
2026-03-20 14:16:07,245 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'internal']"] *********
2026-03-20 14:16:07,245 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:07 +0000 (0:00:00.024)       0:00:33.604 ********** 
2026-03-20 14:16:09,747 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:09,753 p=37687 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 internal endpoint exists] **************
2026-03-20 14:16:09,753 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:09 +0000 (0:00:02.508)       0:00:36.112 ********** 
2026-03-20 14:16:09,776 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint cinderv3 is found."
}
2026-03-20 14:16:09,784 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'public']"] ********
2026-03-20 14:16:09,784 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:09 +0000 (0:00:00.030)       0:00:36.143 ********** 
2026-03-20 14:16:12,447 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:12,453 p=37687 u=zuul n=ansible | TASK [common : TEST Check that barbican public endpoint exists] ****************
2026-03-20 14:16:12,453 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:12 +0000 (0:00:02.669)       0:00:38.812 ********** 
2026-03-20 14:16:12,470 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint barbican is found."
}
2026-03-20 14:16:12,476 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'internal']"] ******
2026-03-20 14:16:12,476 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:12 +0000 (0:00:00.022)       0:00:38.835 ********** 
2026-03-20 14:16:14,970 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:14,976 p=37687 u=zuul n=ansible | TASK [common : TEST Check that barbican internal endpoint exists] **************
2026-03-20 14:16:14,976 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:14 +0000 (0:00:02.500)       0:00:41.335 ********** 
2026-03-20 14:16:14,996 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint barbican is found."
}
2026-03-20 14:16:15,002 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'public']"] ***********
2026-03-20 14:16:15,002 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:15 +0000 (0:00:00.025)       0:00:41.361 ********** 
2026-03-20 14:16:17,457 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:17,464 p=37687 u=zuul n=ansible | TASK [common : TEST Check that keystone public endpoint exists] ****************
2026-03-20 14:16:17,464 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:17 +0000 (0:00:02.462)       0:00:43.823 ********** 
2026-03-20 14:16:17,481 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint keystone is found."
}
2026-03-20 14:16:17,487 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'internal']"] *********
2026-03-20 14:16:17,487 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:17 +0000 (0:00:00.022)       0:00:43.846 ********** 
2026-03-20 14:16:20,146 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:20,153 p=37687 u=zuul n=ansible | TASK [common : TEST Check that keystone internal endpoint exists] **************
2026-03-20 14:16:20,153 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:20 +0000 (0:00:02.666)       0:00:46.512 ********** 
2026-03-20 14:16:20,172 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint keystone is found."
}
2026-03-20 14:16:20,177 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'public']"] ****************
2026-03-20 14:16:20,177 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:20 +0000 (0:00:00.024)       0:00:46.536 ********** 
2026-03-20 14:16:22,719 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:22,725 p=37687 u=zuul n=ansible | TASK [common : TEST Check that glance public endpoint exists] ******************
2026-03-20 14:16:22,726 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:22 +0000 (0:00:02.548)       0:00:49.084 ********** 
2026-03-20 14:16:22,746 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint glance is found."
}
2026-03-20 14:16:22,751 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'internal']"] **************
2026-03-20 14:16:22,751 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:22 +0000 (0:00:00.025)       0:00:49.110 ********** 
2026-03-20 14:16:25,184 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:25,195 p=37687 u=zuul n=ansible | TASK [common : TEST Check that glance internal endpoint exists] ****************
2026-03-20 14:16:25,195 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:25 +0000 (0:00:02.443)       0:00:51.554 ********** 
2026-03-20 14:16:25,216 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint glance is found."
}
2026-03-20 14:16:25,222 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'public']"] *************
2026-03-20 14:16:25,222 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:25 +0000 (0:00:00.027)       0:00:51.581 ********** 
2026-03-20 14:16:27,706 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:27,714 p=37687 u=zuul n=ansible | TASK [common : TEST Check that neutron public endpoint exists] *****************
2026-03-20 14:16:27,714 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:27 +0000 (0:00:02.492)       0:00:54.073 ********** 
2026-03-20 14:16:27,734 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint neutron is found."
}
2026-03-20 14:16:27,741 p=37687 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'internal']"] ***********
2026-03-20 14:16:27,742 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:27 +0000 (0:00:00.027)       0:00:54.100 ********** 
2026-03-20 14:16:30,531 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:30,539 p=37687 u=zuul n=ansible | TASK [common : TEST Check that neutron internal endpoint exists] ***************
2026-03-20 14:16:30,539 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:30 +0000 (0:00:02.797)       0:00:56.898 ********** 
2026-03-20 14:16:30,568 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "The endpoint neutron is found."
}
2026-03-20 14:16:30,575 p=37687 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-20 14:16:30,576 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:30 +0000 (0:00:00.036)       0:00:56.935 ********** 
2026-03-20 14:16:30,622 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-openstack-infra)
2026-03-20 14:16:30,624 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift)
2026-03-20 14:16:30,626 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openstack-operators)
2026-03-20 14:16:30,628 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-logging)
2026-03-20 14:16:30,657 p=37687 u=zuul n=ansible | TASK [common : Get the openshift-openstack-infra project] **********************
2026-03-20 14:16:30,658 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:30 +0000 (0:00:00.081)       0:00:57.016 ********** 
2026-03-20 14:16:31,313 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:31,319 p=37687 u=zuul n=ansible | TASK [common : TEST Verify openshift-openstack-infra project exists] ***********
2026-03-20 14:16:31,319 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:31 +0000 (0:00:00.661)       0:00:57.678 ********** 
2026-03-20 14:16:31,345 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "project openshift-openstack-infra is found."
}
2026-03-20 14:16:31,350 p=37687 u=zuul n=ansible | TASK [common : Get the openshift project] **************************************
2026-03-20 14:16:31,350 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:31 +0000 (0:00:00.031)       0:00:57.709 ********** 
2026-03-20 14:16:31,983 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:31,989 p=37687 u=zuul n=ansible | TASK [common : TEST Verify openshift project exists] ***************************
2026-03-20 14:16:31,989 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:31 +0000 (0:00:00.638)       0:00:58.348 ********** 
2026-03-20 14:16:32,004 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "project openshift is found."
}
2026-03-20 14:16:32,009 p=37687 u=zuul n=ansible | TASK [common : Get the openstack-operators project] ****************************
2026-03-20 14:16:32,009 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:32 +0000 (0:00:00.020)       0:00:58.368 ********** 
2026-03-20 14:16:32,566 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:32,572 p=37687 u=zuul n=ansible | TASK [common : TEST Verify openstack-operators project exists] *****************
2026-03-20 14:16:32,572 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:32 +0000 (0:00:00.562)       0:00:58.930 ********** 
2026-03-20 14:16:32,589 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "project openstack-operators is found."
}
2026-03-20 14:16:32,594 p=37687 u=zuul n=ansible | TASK [common : Get the openshift-logging project] ******************************
2026-03-20 14:16:32,594 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:32 +0000 (0:00:00.022)       0:00:58.953 ********** 
2026-03-20 14:16:33,202 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:33,209 p=37687 u=zuul n=ansible | TASK [common : TEST Verify openshift-logging project exists] *******************
2026-03-20 14:16:33,209 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:33 +0000 (0:00:00.614)       0:00:59.568 ********** 
2026-03-20 14:16:33,235 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "project openshift-logging is found."
}
2026-03-20 14:16:33,239 p=37687 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-20 14:16:33,240 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:33 +0000 (0:00:00.030)       0:00:59.598 ********** 
2026-03-20 14:16:33,357 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=cluster-logging-operator-metrics)
2026-03-20 14:16:33,359 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-grpc)
2026-03-20 14:16:33,360 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-http)
2026-03-20 14:16:33,362 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-grpc)
2026-03-20 14:16:33,364 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-http)
2026-03-20 14:16:33,366 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gateway-http)
2026-03-20 14:16:33,367 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gossip-ring)
2026-03-20 14:16:33,369 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-grpc)
2026-03-20 14:16:33,370 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-http)
2026-03-20 14:16:33,372 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-grpc)
2026-03-20 14:16:33,374 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-http)
2026-03-20 14:16:33,376 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-grpc)
2026-03-20 14:16:33,377 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-http)
2026-03-20 14:16:33,379 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-grpc)
2026-03-20 14:16:33,381 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-http)
2026-03-20 14:16:33,383 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=openstack-logging)
2026-03-20 14:16:33,417 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "cluster-logging-operator-metrics"] ************
2026-03-20 14:16:33,417 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:33 +0000 (0:00:00.177)       0:00:59.776 ********** 
2026-03-20 14:16:34,108 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:34,115 p=37687 u=zuul n=ansible | TASK [common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace] ***
2026-03-20 14:16:34,115 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:34 +0000 (0:00:00.698)       0:01:00.474 ********** 
2026-03-20 14:16:34,139 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service cluster-logging-operator-metrics is running."
}
2026-03-20 14:16:34,145 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-grpc"] *****************
2026-03-20 14:16:34,145 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:34 +0000 (0:00:00.030)       0:01:00.504 ********** 
2026-03-20 14:16:34,778 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:34,786 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace] ***
2026-03-20 14:16:34,786 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:34 +0000 (0:00:00.640)       0:01:01.145 ********** 
2026-03-20 14:16:34,809 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-compactor-grpc is running."
}
2026-03-20 14:16:34,818 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-http"] *****************
2026-03-20 14:16:34,818 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:34 +0000 (0:00:00.031)       0:01:01.177 ********** 
2026-03-20 14:16:35,497 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:35,504 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace] ***
2026-03-20 14:16:35,504 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:35 +0000 (0:00:00.686)       0:01:01.863 ********** 
2026-03-20 14:16:35,529 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-compactor-http is running."
}
2026-03-20 14:16:35,535 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-grpc"] ***************
2026-03-20 14:16:35,536 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:35 +0000 (0:00:00.031)       0:01:01.894 ********** 
2026-03-20 14:16:36,168 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:36,174 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace] ***
2026-03-20 14:16:36,174 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:36 +0000 (0:00:00.638)       0:01:02.533 ********** 
2026-03-20 14:16:36,195 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-distributor-grpc is running."
}
2026-03-20 14:16:36,200 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-http"] ***************
2026-03-20 14:16:36,200 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:36 +0000 (0:00:00.025)       0:01:02.559 ********** 
2026-03-20 14:16:36,739 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:36,745 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace] ***
2026-03-20 14:16:36,745 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:36 +0000 (0:00:00.544)       0:01:03.104 ********** 
2026-03-20 14:16:36,763 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-distributor-http is running."
}
2026-03-20 14:16:36,768 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gateway-http"] *******************
2026-03-20 14:16:36,768 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:36 +0000 (0:00:00.023)       0:01:03.127 ********** 
2026-03-20 14:16:37,309 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:37,315 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace] ***
2026-03-20 14:16:37,315 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:37 +0000 (0:00:00.546)       0:01:03.674 ********** 
2026-03-20 14:16:37,334 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-gateway-http is running."
}
2026-03-20 14:16:37,339 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gossip-ring"] ********************
2026-03-20 14:16:37,339 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:37 +0000 (0:00:00.024)       0:01:03.698 ********** 
2026-03-20 14:16:37,821 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:37,828 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace] ***
2026-03-20 14:16:37,828 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:37 +0000 (0:00:00.488)       0:01:04.187 ********** 
2026-03-20 14:16:37,846 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-gossip-ring is running."
}
2026-03-20 14:16:37,851 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-grpc"] *************
2026-03-20 14:16:37,851 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:37 +0000 (0:00:00.023)       0:01:04.210 ********** 
2026-03-20 14:16:38,431 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:38,436 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace] ***
2026-03-20 14:16:38,436 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:38 +0000 (0:00:00.584)       0:01:04.795 ********** 
2026-03-20 14:16:38,454 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-index-gateway-grpc is running."
}
2026-03-20 14:16:38,460 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-http"] *************
2026-03-20 14:16:38,460 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:38 +0000 (0:00:00.024)       0:01:04.819 ********** 
2026-03-20 14:16:38,945 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:38,950 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace] ***
2026-03-20 14:16:38,950 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:38 +0000 (0:00:00.489)       0:01:05.309 ********** 
2026-03-20 14:16:38,968 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-index-gateway-http is running."
}
2026-03-20 14:16:38,974 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-grpc"] ******************
2026-03-20 14:16:38,974 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:38 +0000 (0:00:00.023)       0:01:05.333 ********** 
2026-03-20 14:16:39,498 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:39,503 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace] ***
2026-03-20 14:16:39,503 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:39 +0000 (0:00:00.529)       0:01:05.862 ********** 
2026-03-20 14:16:39,521 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-ingester-grpc is running."
}
2026-03-20 14:16:39,526 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-http"] ******************
2026-03-20 14:16:39,527 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:39 +0000 (0:00:00.023)       0:01:05.885 ********** 
2026-03-20 14:16:40,025 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:40,030 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace] ***
2026-03-20 14:16:40,030 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:40 +0000 (0:00:00.503)       0:01:06.389 ********** 
2026-03-20 14:16:40,048 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-ingester-http is running."
}
2026-03-20 14:16:40,053 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-grpc"] *******************
2026-03-20 14:16:40,054 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:40 +0000 (0:00:00.023)       0:01:06.412 ********** 
2026-03-20 14:16:40,637 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:40,642 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace] ***
2026-03-20 14:16:40,643 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:40 +0000 (0:00:00.588)       0:01:07.001 ********** 
2026-03-20 14:16:40,660 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-querier-grpc is running."
}
2026-03-20 14:16:40,665 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-http"] *******************
2026-03-20 14:16:40,665 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:40 +0000 (0:00:00.022)       0:01:07.024 ********** 
2026-03-20 14:16:41,197 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:41,202 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace] ***
2026-03-20 14:16:41,203 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:41 +0000 (0:00:00.537)       0:01:07.561 ********** 
2026-03-20 14:16:41,223 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-querier-http is running."
}
2026-03-20 14:16:41,228 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-grpc"] ************
2026-03-20 14:16:41,228 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:41 +0000 (0:00:00.025)       0:01:07.587 ********** 
2026-03-20 14:16:41,742 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:41,749 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace] ***
2026-03-20 14:16:41,749 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:41 +0000 (0:00:00.520)       0:01:08.108 ********** 
2026-03-20 14:16:41,765 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-query-frontend-grpc is running."
}
2026-03-20 14:16:41,771 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-http"] ************
2026-03-20 14:16:41,771 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:41 +0000 (0:00:00.022)       0:01:08.130 ********** 
2026-03-20 14:16:42,332 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:42,337 p=37687 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace] ***
2026-03-20 14:16:42,337 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:42 +0000 (0:00:00.566)       0:01:08.696 ********** 
2026-03-20 14:16:42,355 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service logging-loki-query-frontend-http is running."
}
2026-03-20 14:16:42,360 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "openstack-logging"] ***************************
2026-03-20 14:16:42,360 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:42 +0000 (0:00:00.022)       0:01:08.719 ********** 
2026-03-20 14:16:42,862 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:42,869 p=37687 u=zuul n=ansible | TASK [common : TEST Verify openstack-logging service is running in openshift-logging namespace] ***
2026-03-20 14:16:42,869 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:42 +0000 (0:00:00.509)       0:01:09.228 ********** 
2026-03-20 14:16:42,887 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service openstack-logging is running."
}
2026-03-20 14:16:42,892 p=37687 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-20 14:16:42,892 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:42 +0000 (0:00:00.023)       0:01:09.251 ********** 
2026-03-20 14:16:42,907 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:42,912 p=37687 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-20 14:16:42,913 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:42 +0000 (0:00:00.020)       0:01:09.271 ********** 
2026-03-20 14:16:43,500 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:43,507 p=37687 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-20 14:16:43,507 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:43 +0000 (0:00:00.594)       0:01:09.866 ********** 
2026-03-20 14:16:43,531 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/manifest_tests.yml for controller => (item={'name': 'loki-operator', 'expected_number': 2})
2026-03-20 14:16:43,552 p=37687 u=zuul n=ansible | TASK [common : TEST Get loki-operator 2 packagemanifest] ***********************
2026-03-20 14:16:43,552 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:43 +0000 (0:00:00.045)       0:01:09.911 ********** 
2026-03-20 14:16:43,616 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "Expected 2 and found 2\n"
}
2026-03-20 14:16:43,621 p=37687 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-20 14:16:43,621 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:43 +0000 (0:00:00.068)       0:01:09.980 ********** 
2026-03-20 14:16:43,637 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:43,641 p=37687 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-20 14:16:43,641 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:43 +0000 (0:00:00.019)       0:01:10.000 ********** 
2026-03-20 14:16:43,657 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:43,661 p=37687 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-20 14:16:43,661 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:43 +0000 (0:00:00.019)       0:01:10.020 ********** 
2026-03-20 14:16:43,678 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:43,694 p=37687 u=zuul n=ansible | PLAY [Verify logging pods are running in openstack] ****************************
2026-03-20 14:16:43,702 p=37687 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-20 14:16:43,703 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:43 +0000 (0:00:00.041)       0:01:10.061 ********** 
2026-03-20 14:16:43,728 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstackclient)
2026-03-20 14:16:43,734 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:16:43,734 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:43 +0000 (0:00:00.031)       0:01:10.093 ********** 
2026-03-20 14:16:44,280 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:44,286 p=37687 u=zuul n=ansible | TASK [common : TEST Check openstackclient pod is Running in openstack namespace] ***
2026-03-20 14:16:44,286 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.552)       0:01:10.645 ********** 
2026-03-20 14:16:44,767 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:44,771 p=37687 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-20 14:16:44,771 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.485)       0:01:11.130 ********** 
2026-03-20 14:16:44,785 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:44,789 p=37687 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-20 14:16:44,789 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.017)       0:01:11.147 ********** 
2026-03-20 14:16:44,804 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:44,810 p=37687 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-20 14:16:44,810 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.021)       0:01:11.169 ********** 
2026-03-20 14:16:44,827 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:44,831 p=37687 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-20 14:16:44,831 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.021)       0:01:11.190 ********** 
2026-03-20 14:16:44,846 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:44,849 p=37687 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-20 14:16:44,849 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.017)       0:01:11.208 ********** 
2026-03-20 14:16:44,863 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:44,867 p=37687 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-20 14:16:44,867 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.017)       0:01:11.226 ********** 
2026-03-20 14:16:44,882 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:44,885 p=37687 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-20 14:16:44,886 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.018)       0:01:11.244 ********** 
2026-03-20 14:16:44,903 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:44,907 p=37687 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-20 14:16:44,907 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.021)       0:01:11.266 ********** 
2026-03-20 14:16:44,926 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:44,929 p=37687 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-20 14:16:44,929 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.022)       0:01:11.288 ********** 
2026-03-20 14:16:44,943 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:44,947 p=37687 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-20 14:16:44,947 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.017)       0:01:11.306 ********** 
2026-03-20 14:16:44,964 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:44,975 p=37687 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-operators-redhat] ***********
2026-03-20 14:16:44,983 p=37687 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-20 14:16:44,983 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:44 +0000 (0:00:00.036)       0:01:11.342 ********** 
2026-03-20 14:16:45,009 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=loki-operator-controller-manager)
2026-03-20 14:16:45,014 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:16:45,014 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:45 +0000 (0:00:00.031)       0:01:11.373 ********** 
2026-03-20 14:16:45,543 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:45,549 p=37687 u=zuul n=ansible | TASK [common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace] ***
2026-03-20 14:16:45,549 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:45 +0000 (0:00:00.534)       0:01:11.908 ********** 
2026-03-20 14:16:46,064 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:46,068 p=37687 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-20 14:16:46,068 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.519)       0:01:12.427 ********** 
2026-03-20 14:16:46,089 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:46,093 p=37687 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-20 14:16:46,093 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.024)       0:01:12.451 ********** 
2026-03-20 14:16:46,109 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:46,113 p=37687 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-20 14:16:46,113 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.020)       0:01:12.472 ********** 
2026-03-20 14:16:46,131 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:46,135 p=37687 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-20 14:16:46,135 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.021)       0:01:12.494 ********** 
2026-03-20 14:16:46,155 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:46,158 p=37687 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-20 14:16:46,158 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.023)       0:01:12.517 ********** 
2026-03-20 14:16:46,176 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:46,180 p=37687 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-20 14:16:46,180 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.021)       0:01:12.539 ********** 
2026-03-20 14:16:46,197 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:46,201 p=37687 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-20 14:16:46,201 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.020)       0:01:12.560 ********** 
2026-03-20 14:16:46,218 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:46,222 p=37687 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-20 14:16:46,222 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.021)       0:01:12.581 ********** 
2026-03-20 14:16:46,240 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:46,244 p=37687 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-20 14:16:46,244 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.021)       0:01:12.603 ********** 
2026-03-20 14:16:46,262 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:46,265 p=37687 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-20 14:16:46,265 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.021)       0:01:12.624 ********** 
2026-03-20 14:16:46,285 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:46,297 p=37687 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-logging] ********************
2026-03-20 14:16:46,305 p=37687 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-20 14:16:46,305 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.039)       0:01:12.664 ********** 
2026-03-20 14:16:46,385 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=cluster-logging-operator)
2026-03-20 14:16:46,387 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-compactor)
2026-03-20 14:16:46,389 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-distributor)
2026-03-20 14:16:46,391 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-index-gateway)
2026-03-20 14:16:46,393 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-ingester)
2026-03-20 14:16:46,394 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-querier)
2026-03-20 14:16:46,396 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-query-frontend)
2026-03-20 14:16:46,398 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=collector)
2026-03-20 14:16:46,403 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:16:46,403 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.098)       0:01:12.762 ********** 
2026-03-20 14:16:46,960 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:46,965 p=37687 u=zuul n=ansible | TASK [common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace] ***
2026-03-20 14:16:46,965 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:46 +0000 (0:00:00.562)       0:01:13.324 ********** 
2026-03-20 14:16:47,493 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:47,497 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:16:47,498 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:47 +0000 (0:00:00.532)       0:01:13.856 ********** 
2026-03-20 14:16:48,037 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:48,043 p=37687 u=zuul n=ansible | TASK [common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace] ***
2026-03-20 14:16:48,043 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:48 +0000 (0:00:00.545)       0:01:14.402 ********** 
2026-03-20 14:16:48,573 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:48,578 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:16:48,578 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:48 +0000 (0:00:00.535)       0:01:14.937 ********** 
2026-03-20 14:16:49,155 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:49,160 p=37687 u=zuul n=ansible | TASK [common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace] ***
2026-03-20 14:16:49,160 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:49 +0000 (0:00:00.582)       0:01:15.519 ********** 
2026-03-20 14:16:49,723 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:49,728 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:16:49,728 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:49 +0000 (0:00:00.567)       0:01:16.087 ********** 
2026-03-20 14:16:50,277 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:50,282 p=37687 u=zuul n=ansible | TASK [common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace] ***
2026-03-20 14:16:50,283 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:50 +0000 (0:00:00.554)       0:01:16.641 ********** 
2026-03-20 14:16:50,834 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:50,839 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:16:50,839 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:50 +0000 (0:00:00.556)       0:01:17.198 ********** 
2026-03-20 14:16:51,390 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:51,396 p=37687 u=zuul n=ansible | TASK [common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace] ***
2026-03-20 14:16:51,396 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:51 +0000 (0:00:00.556)       0:01:17.755 ********** 
2026-03-20 14:16:51,928 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:51,933 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:16:51,933 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:51 +0000 (0:00:00.537)       0:01:18.292 ********** 
2026-03-20 14:16:52,443 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:52,450 p=37687 u=zuul n=ansible | TASK [common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace] ***
2026-03-20 14:16:52,450 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:52 +0000 (0:00:00.516)       0:01:18.809 ********** 
2026-03-20 14:16:53,001 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:53,006 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:16:53,006 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:53 +0000 (0:00:00.556)       0:01:19.365 ********** 
2026-03-20 14:16:53,553 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:53,557 p=37687 u=zuul n=ansible | TASK [common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace] ***
2026-03-20 14:16:53,558 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:53 +0000 (0:00:00.551)       0:01:19.916 ********** 
2026-03-20 14:16:54,088 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:54,093 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:16:54,094 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:54 +0000 (0:00:00.536)       0:01:20.452 ********** 
2026-03-20 14:16:54,652 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:54,658 p=37687 u=zuul n=ansible | TASK [common : TEST Check collector pod is Running in openshift-logging namespace] ***
2026-03-20 14:16:54,658 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:54 +0000 (0:00:00.564)       0:01:21.017 ********** 
2026-03-20 14:16:55,162 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:55,166 p=37687 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-20 14:16:55,166 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.508)       0:01:21.525 ********** 
2026-03-20 14:16:55,184 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:55,188 p=37687 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-20 14:16:55,188 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.022)       0:01:21.547 ********** 
2026-03-20 14:16:55,206 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:55,210 p=37687 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-20 14:16:55,210 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.021)       0:01:21.568 ********** 
2026-03-20 14:16:55,231 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:55,235 p=37687 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-20 14:16:55,236 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.025)       0:01:21.594 ********** 
2026-03-20 14:16:55,254 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:55,258 p=37687 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-20 14:16:55,258 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.022)       0:01:21.617 ********** 
2026-03-20 14:16:55,278 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:55,281 p=37687 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-20 14:16:55,281 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.023)       0:01:21.640 ********** 
2026-03-20 14:16:55,299 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:55,303 p=37687 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-20 14:16:55,303 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.021)       0:01:21.662 ********** 
2026-03-20 14:16:55,320 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:55,325 p=37687 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-20 14:16:55,325 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.022)       0:01:21.684 ********** 
2026-03-20 14:16:55,343 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:55,347 p=37687 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-20 14:16:55,347 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.022)       0:01:21.706 ********** 
2026-03-20 14:16:55,363 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:55,367 p=37687 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-20 14:16:55,367 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.020)       0:01:21.726 ********** 
2026-03-20 14:16:55,383 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:55,403 p=37687 u=zuul n=ansible | PLAY [Verify logging pods are running in minio-dev] ****************************
2026-03-20 14:16:55,413 p=37687 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-20 14:16:55,413 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.045)       0:01:21.772 ********** 
2026-03-20 14:16:55,441 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=minio)
2026-03-20 14:16:55,447 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ********************************
2026-03-20 14:16:55,447 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:55 +0000 (0:00:00.033)       0:01:21.806 ********** 
2026-03-20 14:16:56,006 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:56,012 p=37687 u=zuul n=ansible | TASK [common : TEST Check minio pod is Running in minio-dev namespace] *********
2026-03-20 14:16:56,012 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.565)       0:01:22.371 ********** 
2026-03-20 14:16:56,569 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:56,573 p=37687 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-20 14:16:56,573 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.561)       0:01:22.932 ********** 
2026-03-20 14:16:56,591 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:56,595 p=37687 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-20 14:16:56,595 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.021)       0:01:22.953 ********** 
2026-03-20 14:16:56,612 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:56,616 p=37687 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-20 14:16:56,617 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.022)       0:01:22.975 ********** 
2026-03-20 14:16:56,634 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:56,638 p=37687 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-20 14:16:56,639 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.021)       0:01:22.997 ********** 
2026-03-20 14:16:56,655 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:56,659 p=37687 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-20 14:16:56,659 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.020)       0:01:23.017 ********** 
2026-03-20 14:16:56,676 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:56,680 p=37687 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-20 14:16:56,680 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.021)       0:01:23.039 ********** 
2026-03-20 14:16:56,696 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:56,699 p=37687 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-20 14:16:56,699 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.019)       0:01:23.058 ********** 
2026-03-20 14:16:56,717 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:56,721 p=37687 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-20 14:16:56,721 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.021)       0:01:23.080 ********** 
2026-03-20 14:16:56,740 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:56,743 p=37687 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-20 14:16:56,744 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.022)       0:01:23.102 ********** 
2026-03-20 14:16:56,761 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:56,765 p=37687 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-20 14:16:56,765 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.021)       0:01:23.124 ********** 
2026-03-20 14:16:56,784 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:16:56,796 p=37687 u=zuul n=ansible | PLAY [Verify logging pods have complete status in openstack] *******************
2026-03-20 14:16:56,803 p=37687 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-20 14:16:56,804 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.038)       0:01:23.162 ********** 
2026-03-20 14:16:56,918 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=bootstrap-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,920 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-network-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,922 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-os-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,924 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-certs-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,926 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-os-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,928 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=libvirt-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,931 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,933 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=neutron-metadata-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,935 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ovn-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,937 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=reboot-os-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,939 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=run-os-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,941 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ssh-known-hosts-edpm-deployment)
2026-03-20 14:16:56,943 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,945 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=validate-network-edpm-deployment-openstack-edpm-ipam)
2026-03-20 14:16:56,951 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:16:56,951 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:56 +0000 (0:00:00.147)       0:01:23.310 ********** 
2026-03-20 14:16:57,550 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:57,554 p=37687 u=zuul n=ansible | TASK [common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:16:57,555 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:57 +0000 (0:00:00.603)       0:01:23.913 ********** 
2026-03-20 14:16:58,087 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:58,094 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:16:58,094 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:58 +0000 (0:00:00.539)       0:01:24.453 ********** 
2026-03-20 14:16:58,662 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:58,667 p=37687 u=zuul n=ansible | TASK [common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:16:58,667 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:58 +0000 (0:00:00.573)       0:01:25.026 ********** 
2026-03-20 14:16:59,214 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:59,219 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:16:59,219 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:59 +0000 (0:00:00.551)       0:01:25.578 ********** 
2026-03-20 14:16:59,819 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:16:59,824 p=37687 u=zuul n=ansible | TASK [common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:16:59,824 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:16:59 +0000 (0:00:00.604)       0:01:26.183 ********** 
2026-03-20 14:17:00,313 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:00,317 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:17:00,317 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:00 +0000 (0:00:00.493)       0:01:26.676 ********** 
2026-03-20 14:17:00,906 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:00,911 p=37687 u=zuul n=ansible | TASK [common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:17:00,912 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:00 +0000 (0:00:00.594)       0:01:27.270 ********** 
2026-03-20 14:17:01,474 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:01,479 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:17:01,479 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:01 +0000 (0:00:00.567)       0:01:27.838 ********** 
2026-03-20 14:17:02,112 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:02,119 p=37687 u=zuul n=ansible | TASK [common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:17:02,120 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:02 +0000 (0:00:00.640)       0:01:28.478 ********** 
2026-03-20 14:17:02,637 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:02,643 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:17:02,643 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:02 +0000 (0:00:00.523)       0:01:29.002 ********** 
2026-03-20 14:17:03,217 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:03,224 p=37687 u=zuul n=ansible | TASK [common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:17:03,224 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:03 +0000 (0:00:00.581)       0:01:29.583 ********** 
2026-03-20 14:17:03,849 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:03,854 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:17:03,854 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:03 +0000 (0:00:00.629)       0:01:30.213 ********** 
2026-03-20 14:17:04,613 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:04,619 p=37687 u=zuul n=ansible | TASK [common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:17:04,619 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:04 +0000 (0:00:00.765)       0:01:30.978 ********** 
2026-03-20 14:17:05,321 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:05,331 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:17:05,332 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:05 +0000 (0:00:00.713)       0:01:31.691 ********** 
2026-03-20 14:17:06,088 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:06,097 p=37687 u=zuul n=ansible | TASK [common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:17:06,098 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:06 +0000 (0:00:00.765)       0:01:32.457 ********** 
2026-03-20 14:17:06,743 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:06,748 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:17:06,748 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:06 +0000 (0:00:00.650)       0:01:33.107 ********** 
2026-03-20 14:17:07,452 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:07,458 p=37687 u=zuul n=ansible | TASK [common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:17:07,458 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:07 +0000 (0:00:00.710)       0:01:33.817 ********** 
2026-03-20 14:17:08,069 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:08,075 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:17:08,076 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:08 +0000 (0:00:00.616)       0:01:34.434 ********** 
2026-03-20 14:17:08,734 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:08,740 p=37687 u=zuul n=ansible | TASK [common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:17:08,740 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:08 +0000 (0:00:00.664)       0:01:35.099 ********** 
2026-03-20 14:17:09,400 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:09,406 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:17:09,406 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:09 +0000 (0:00:00.665)       0:01:35.765 ********** 
2026-03-20 14:17:09,989 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:09,996 p=37687 u=zuul n=ansible | TASK [common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:17:09,996 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:09 +0000 (0:00:00.590)       0:01:36.355 ********** 
2026-03-20 14:17:10,574 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:10,579 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:17:10,579 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:10 +0000 (0:00:00.582)       0:01:36.938 ********** 
2026-03-20 14:17:11,170 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:11,175 p=37687 u=zuul n=ansible | TASK [common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace] ***
2026-03-20 14:17:11,176 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:11 +0000 (0:00:00.596)       0:01:37.534 ********** 
2026-03-20 14:17:11,721 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:11,726 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:17:11,727 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:11 +0000 (0:00:00.550)       0:01:38.085 ********** 
2026-03-20 14:17:12,334 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:12,340 p=37687 u=zuul n=ansible | TASK [common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:17:12,340 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:12 +0000 (0:00:00.613)       0:01:38.699 ********** 
2026-03-20 14:17:12,892 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:12,897 p=37687 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ******************************
2026-03-20 14:17:12,897 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:12 +0000 (0:00:00.556)       0:01:39.256 ********** 
2026-03-20 14:17:13,495 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:13,499 p=37687 u=zuul n=ansible | TASK [common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] ***
2026-03-20 14:17:13,499 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:13 +0000 (0:00:00.602)       0:01:39.858 ********** 
2026-03-20 14:17:14,069 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:14,073 p=37687 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-20 14:17:14,073 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.573)       0:01:40.432 ********** 
2026-03-20 14:17:14,088 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,092 p=37687 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-20 14:17:14,092 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.019)       0:01:40.451 ********** 
2026-03-20 14:17:14,109 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,112 p=37687 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-20 14:17:14,113 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.020)       0:01:40.471 ********** 
2026-03-20 14:17:14,130 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,134 p=37687 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-20 14:17:14,134 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.021)       0:01:40.493 ********** 
2026-03-20 14:17:14,151 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,155 p=37687 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-20 14:17:14,155 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.020)       0:01:40.513 ********** 
2026-03-20 14:17:14,173 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,177 p=37687 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-20 14:17:14,177 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.021)       0:01:40.535 ********** 
2026-03-20 14:17:14,193 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,196 p=37687 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-20 14:17:14,197 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.019)       0:01:40.555 ********** 
2026-03-20 14:17:14,213 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,216 p=37687 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-20 14:17:14,216 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.019)       0:01:40.575 ********** 
2026-03-20 14:17:14,236 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,240 p=37687 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-20 14:17:14,240 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.023)       0:01:40.599 ********** 
2026-03-20 14:17:14,257 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,261 p=37687 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-20 14:17:14,261 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.020)       0:01:40.620 ********** 
2026-03-20 14:17:14,278 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,290 p=37687 u=zuul n=ansible | PLAY [Verify the crds exist] ***************************************************
2026-03-20 14:17:14,298 p=37687 u=zuul n=ansible | TASK [common : Run pod tests] **************************************************
2026-03-20 14:17:14,298 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.037)       0:01:40.657 ********** 
2026-03-20 14:17:14,318 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,321 p=37687 u=zuul n=ansible | TASK [common : Run subscription tests] *****************************************
2026-03-20 14:17:14,321 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.023)       0:01:40.680 ********** 
2026-03-20 14:17:14,341 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,345 p=37687 u=zuul n=ansible | TASK [common : Run endpoint tests] *********************************************
2026-03-20 14:17:14,345 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.024)       0:01:40.704 ********** 
2026-03-20 14:17:14,365 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,369 p=37687 u=zuul n=ansible | TASK [common : Run project tests] **********************************************
2026-03-20 14:17:14,369 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.023)       0:01:40.728 ********** 
2026-03-20 14:17:14,389 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:14,394 p=37687 u=zuul n=ansible | TASK [common : Run service tests] **********************************************
2026-03-20 14:17:14,394 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.024)       0:01:40.753 ********** 
2026-03-20 14:17:14,443 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-internal)
2026-03-20 14:17:14,444 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-metadata-internal)
2026-03-20 14:17:14,445 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-novncproxy-cell1-public)
2026-03-20 14:17:14,447 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-public)
2026-03-20 14:17:14,453 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "nova-internal"] *******************************
2026-03-20 14:17:14,453 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:14 +0000 (0:00:00.058)       0:01:40.811 ********** 
2026-03-20 14:17:14,997 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:15,001 p=37687 u=zuul n=ansible | TASK [common : TEST Verify nova-internal service is running in openstack namespace] ***
2026-03-20 14:17:15,001 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:15 +0000 (0:00:00.548)       0:01:41.360 ********** 
2026-03-20 14:17:15,020 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service nova-internal is running."
}
2026-03-20 14:17:15,025 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "nova-metadata-internal"] **********************
2026-03-20 14:17:15,025 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:15 +0000 (0:00:00.023)       0:01:41.384 ********** 
2026-03-20 14:17:15,529 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:15,533 p=37687 u=zuul n=ansible | TASK [common : TEST Verify nova-metadata-internal service is running in openstack namespace] ***
2026-03-20 14:17:15,534 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:15 +0000 (0:00:00.508)       0:01:41.892 ********** 
2026-03-20 14:17:15,550 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service nova-metadata-internal is running."
}
2026-03-20 14:17:15,554 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "nova-novncproxy-cell1-public"] ****************
2026-03-20 14:17:15,554 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:15 +0000 (0:00:00.020)       0:01:41.913 ********** 
2026-03-20 14:17:16,051 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:16,056 p=37687 u=zuul n=ansible | TASK [common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace] ***
2026-03-20 14:17:16,056 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:16 +0000 (0:00:00.501)       0:01:42.415 ********** 
2026-03-20 14:17:16,076 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service nova-novncproxy-cell1-public is running."
}
2026-03-20 14:17:16,081 p=37687 u=zuul n=ansible | TASK [common : Verify Service - "nova-public"] *********************************
2026-03-20 14:17:16,081 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:16 +0000 (0:00:00.024)       0:01:42.440 ********** 
2026-03-20 14:17:16,615 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:16,620 p=37687 u=zuul n=ansible | TASK [common : TEST Verify nova-public service is running in openstack namespace] ***
2026-03-20 14:17:16,620 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:16 +0000 (0:00:00.539)       0:01:42.979 ********** 
2026-03-20 14:17:16,639 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "service nova-public is running."
}
2026-03-20 14:17:16,642 p=37687 u=zuul n=ansible | TASK [common : Run file tests] *************************************************
2026-03-20 14:17:16,642 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:16 +0000 (0:00:00.021)       0:01:43.001 ********** 
2026-03-20 14:17:16,663 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:16,667 p=37687 u=zuul n=ansible | TASK [common : Get the manifest list once] *************************************
2026-03-20 14:17:16,667 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:16 +0000 (0:00:00.025)       0:01:43.026 ********** 
2026-03-20 14:17:16,685 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:16,690 p=37687 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ********************
2026-03-20 14:17:16,690 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:16 +0000 (0:00:00.022)       0:01:43.049 ********** 
2026-03-20 14:17:16,709 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:16,713 p=37687 u=zuul n=ansible | TASK [common : Run crd tests] **************************************************
2026-03-20 14:17:16,714 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:16 +0000 (0:00:00.023)       0:01:43.072 ********** 
2026-03-20 14:17:16,757 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=alertingrules.loki.grafana.com)
2026-03-20 14:17:16,759 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=lokistacks.loki.grafana.com)
2026-03-20 14:17:16,760 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=recordingrules.loki.grafana.com)
2026-03-20 14:17:16,762 p=37687 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=rulerconfigs.loki.grafana.com)
2026-03-20 14:17:16,768 p=37687 u=zuul n=ansible | TASK [common : Verify CRD "alertingrules.loki.grafana.com"] ********************
2026-03-20 14:17:16,768 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:16 +0000 (0:00:00.054)       0:01:43.127 ********** 
2026-03-20 14:17:17,270 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:17,275 p=37687 u=zuul n=ansible | TASK [common : TEST Verify CRD alertingrules.loki.grafana.com is found] ********
2026-03-20 14:17:17,275 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:17 +0000 (0:00:00.506)       0:01:43.634 ********** 
2026-03-20 14:17:17,297 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "CRD alertingrules.loki.grafana.com is found."
}
2026-03-20 14:17:17,303 p=37687 u=zuul n=ansible | TASK [common : Verify CRD "lokistacks.loki.grafana.com"] ***********************
2026-03-20 14:17:17,303 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:17 +0000 (0:00:00.027)       0:01:43.662 ********** 
2026-03-20 14:17:17,831 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:17,836 p=37687 u=zuul n=ansible | TASK [common : TEST Verify CRD lokistacks.loki.grafana.com is found] ***********
2026-03-20 14:17:17,837 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:17 +0000 (0:00:00.533)       0:01:44.195 ********** 
2026-03-20 14:17:17,852 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "CRD lokistacks.loki.grafana.com is found."
}
2026-03-20 14:17:17,856 p=37687 u=zuul n=ansible | TASK [common : Verify CRD "recordingrules.loki.grafana.com"] *******************
2026-03-20 14:17:17,856 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:17 +0000 (0:00:00.019)       0:01:44.215 ********** 
2026-03-20 14:17:18,386 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:18,392 p=37687 u=zuul n=ansible | TASK [common : TEST Verify CRD recordingrules.loki.grafana.com is found] *******
2026-03-20 14:17:18,392 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:18 +0000 (0:00:00.535)       0:01:44.751 ********** 
2026-03-20 14:17:18,415 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "CRD recordingrules.loki.grafana.com is found."
}
2026-03-20 14:17:18,420 p=37687 u=zuul n=ansible | TASK [common : Verify CRD "rulerconfigs.loki.grafana.com"] *********************
2026-03-20 14:17:18,420 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:18 +0000 (0:00:00.028)       0:01:44.779 ********** 
2026-03-20 14:17:19,017 p=37687 u=zuul n=ansible | ok: [controller]
2026-03-20 14:17:19,022 p=37687 u=zuul n=ansible | TASK [common : TEST Verify CRD rulerconfigs.loki.grafana.com is found] *********
2026-03-20 14:17:19,023 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:19 +0000 (0:00:00.602)       0:01:45.381 ********** 
2026-03-20 14:17:19,047 p=37687 u=zuul n=ansible | ok: [controller] => {
    "changed": false,
    "msg": "CRD rulerconfigs.loki.grafana.com is found."
}
2026-03-20 14:17:19,051 p=37687 u=zuul n=ansible | TASK [common : Run CR tests] ***************************************************
2026-03-20 14:17:19,051 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:19 +0000 (0:00:00.028)       0:01:45.410 ********** 
2026-03-20 14:17:19,069 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:19,072 p=37687 u=zuul n=ansible | TASK [common : Verify container tests] *****************************************
2026-03-20 14:17:19,072 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:19 +0000 (0:00:00.021)       0:01:45.431 ********** 
2026-03-20 14:17:19,089 p=37687 u=zuul n=ansible | skipping: [controller]
2026-03-20 14:17:19,101 p=37687 u=zuul n=ansible | PLAY RECAP *********************************************************************
2026-03-20 14:17:19,101 p=37687 u=zuul n=ansible | compute-0                  : ok=19   changed=0    unreachable=0    failed=0    skipped=24   rescued=0    ignored=0   
2026-03-20 14:17:19,101 p=37687 u=zuul n=ansible | controller                 : ok=219  changed=0    unreachable=0    failed=0    skipped=63   rescued=0    ignored=0   
2026-03-20 14:17:19,160 p=37687 u=zuul n=ansible | Friday 20 March 2026  14:17:19 +0000 (0:00:00.087)       0:01:45.519 ********** 
2026-03-20 14:17:19,160 p=37687 u=zuul n=ansible | =============================================================================== 
2026-03-20 14:17:19,160 p=37687 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'public']" ---------------- 2.85s
2026-03-20 14:17:19,160 p=37687 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'internal']" ----------- 2.80s
2026-03-20 14:17:19,160 p=37687 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'public']" --------- 2.68s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'public']" -------- 2.67s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'internal']" --------- 2.67s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'internal']" -------- 2.65s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'public']" ----------- 2.58s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'public']" ---------- 2.57s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'public']" ---------------- 2.55s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'internal']" --------- 2.51s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute
RHOSO-XXX
 ----------- 2.50s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'internal']" ------ 2.50s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'public']" ------------- 2.49s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'internal']" ------- 2.47s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'public']" ----------- 2.46s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'internal']" -------------- 2.44s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'internal']" -------------- 2.43s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 2.39s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 1.93s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get container status ------------------------------------------- 1.19s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute
RHOSO-XXX
 --- 1.09s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf" -------- 0.86s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.86s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.84s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.77s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.76s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.71s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.71s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify Service - "cluster-logging-operator-metrics" ------------ 0.70s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-http" ----------------- 0.69s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.67s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.66s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get the openshift-openstack-infra project ---------------------- 0.66s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.65s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-grpc" ----------------- 0.64s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.64s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get the openshift project -------------------------------------- 0.64s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-grpc" --------------- 0.64s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.63s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.62s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get the openshift-logging project ------------------------------ 0.62s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s
2026-03-20 14:17:19,161 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.60s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.60s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Verify CRD "rulerconfigs.loki.grafana.com" --------------------- 0.60s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.60s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.60s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.59s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.59s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.59s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-grpc" ------------------- 0.59s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-grpc" ------------- 0.58s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.58s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.58s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.58s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.57s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.57s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace
 --- 0.57s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.57s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-http" ------------ 0.57s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.56s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.56s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get the openstack-operators project ---------------------------- 0.56s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.56s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check minio pod is Running in minio-dev namespace
 -------- 0.56s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace
 --- 0.56s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.56s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.56s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace
 --- 0.56s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.55s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace
 --- 0.55s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace
 --- 0.55s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Verify Service - "nova-internal" ------------------------------- 0.55s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-gateway-http" ------------------- 0.55s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-http" --------------- 0.54s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.54s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Verify Service - "nova-public" --------------------------------- 0.54s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-http" ------------------- 0.54s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace
 --- 0.54s
2026-03-20 14:17:19,162 p=37687 u=zuul n=ansible | common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace
 --- 0.54s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify CRD "recordingrules.loki.grafana.com" ------------------- 0.54s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace
 --- 0.54s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.53s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace
 --- 0.53s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify CRD "lokistacks.loki.grafana.com" ----------------------- 0.53s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace
 --- 0.53s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-grpc" ------------------ 0.53s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.52s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-grpc" ------------ 0.52s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace
 --- 0.52s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.52s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify subscription "loki-operator" ---------------------------- 0.52s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify Service - "openstack-logging" --------------------------- 0.51s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify Service - "nova-metadata-internal" ---------------------- 0.51s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : TEST Check collector pod is Running in openshift-logging namespace
 --- 0.51s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify CRD "alertingrules.loki.grafana.com" -------------------- 0.51s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-http" ------------------ 0.50s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify Service - "nova-novncproxy-cell1-public" ---------------- 0.50s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace
 --- 0.49s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-http" ------------- 0.49s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify Service - "logging-loki-gossip-ring" -------------------- 0.49s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : TEST Check openstackclient pod is Running in openstack namespace
 --- 0.49s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.18s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.15s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.13s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.10s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute
RHOSO-XXX
 ----------- 0.09s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.09s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.08s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : TEST Verify node_exporter container status
 -------------------- 0.08s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : TEST Get loki-operator 2 packagemanifest
 ---------------------- 0.07s
2026-03-20 14:17:19,163 p=37687 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.06s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.06s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.05s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists
 --- 0.05s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.05s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute
RHOSO-XXX
 --- 0.05s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.05s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | telemetry_logging : Verify journal entries ------------------------------ 0.04s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Verify ceilometer_agent_compute container status
 --------- 0.04s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.04s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.04s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Check that neutron internal endpoint exists
 -------------- 0.04s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.04s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace
 --- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Verify openshift-openstack-infra project exists
 ---------- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace
 --- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Check that cinderv3 internal endpoint exists
 ------------- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Verify openshift-logging project exists
 ------------------ 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace
 --- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Verify CRD recordingrules.loki.grafana.com is found
 ------ 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Verify CRD rulerconfigs.loki.grafana.com is found
 -------- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Verify CRD alertingrules.loki.grafana.com is found
 ------- 0.03s
2026-03-20 14:17:19,164 p=37687 u=zuul n=ansible | common : TEST Check that neutron public endpoint exists
 ---------------- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Check that nova internal endpoint exists
 ----------------- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Check that glance internal endpoint exists
 --------------- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace
 --- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Check that barbican internal endpoint exists
 ------------- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Check that glance public endpoint exists
 ----------------- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace
 --- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace
 --- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Check that cinderv3 public endpoint exists
 --------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Check that keystone internal endpoint exists
 ------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace
 --- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace
 --- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Check that placement internal endpoint exists
 ------------ 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Verify nova-internal service is running in openstack namespace
 --- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace
 --- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace
 --- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : TEST Check that placement public endpoint exists
 -------------- 0.02s
2026-03-20 14:17:19,165 p=37687 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace
 --- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace
 --- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace
 --- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace
 --- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Verify openstack-logging service is running in openshift-logging namespace
 --- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Check that keystone public endpoint exists
 --------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Check that barbican public endpoint exists
 --------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace
 --- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace
 --- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Check that nova public endpoint exists
 ------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Verify openstack-operators project exists
 ---------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace
 --- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : TEST Verify nova-public service is running in openstack namespace
 --- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-20 14:17:19,166 p=37687 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : TEST Check that swift public endpoint exists
 ------------------ 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : TEST Verify nova-metadata-internal service is running in openstack namespace
 --- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : TEST Check that swift internal endpoint exists
 ---------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : TEST Verify openshift project exists
 -------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : TEST Verify CRD lokistacks.loki.grafana.com is found
 ---------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s
2026-03-20 14:17:19,167 p=37687 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s