2026-03-19 17:27:29,591 p=37082 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace 2026-03-19 17:27:29,591 p=37082 u=zuul n=ansible | PLAY [Verify all the applicable projects, endpoints, pods & services for cloudkitty] *** 2026-03-19 17:27:29,599 p=37082 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-19 17:27:29,599 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:29 +0000 (0:00:00.022) 0:00:00.022 ******** 2026-03-19 17:27:30,613 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:30,643 p=37082 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-19 17:27:30,643 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:30 +0000 (0:00:01.043) 0:00:01.066 ******** 2026-03-19 17:27:30,735 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-api) 2026-03-19 17:27:30,739 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-compactor) 2026-03-19 17:27:30,742 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-distributor) 2026-03-19 17:27:30,746 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway) 2026-03-19 17:27:30,750 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-ingester) 2026-03-19 17:27:30,754 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-querier) 2026-03-19 17:27:30,757 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend) 2026-03-19 17:27:30,762 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-proc) 2026-03-19 17:27:30,776 p=37082 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-19 17:27:30,776 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:30 +0000 (0:00:00.132) 0:00:01.199 ******** 2026-03-19 17:27:31,262 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:31,271 p=37082 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-api pod is Running in openstack namespace] *** 2026-03-19 17:27:31,271 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:31 +0000 (0:00:00.494) 0:00:01.694 ******** 2026-03-19 17:27:31,616 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:31,625 p=37082 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-19 17:27:31,625 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:31 +0000 (0:00:00.354) 0:00:02.048 ******** 2026-03-19 17:27:32,014 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:32,025 p=37082 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-compactor pod is Running in openstack namespace] *** 2026-03-19 17:27:32,026 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:32 +0000 (0:00:00.400) 0:00:02.449 ******** 2026-03-19 17:27:32,345 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:32,353 p=37082 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-19 17:27:32,353 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:32 +0000 (0:00:00.327) 0:00:02.776 ******** 2026-03-19 17:27:32,698 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:32,706 p=37082 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-distributor pod is Running in openstack namespace] *** 2026-03-19 17:27:32,706 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:32 +0000 (0:00:00.353) 0:00:03.129 ******** 2026-03-19 17:27:33,090 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:33,105 p=37082 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-19 17:27:33,105 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:33 +0000 (0:00:00.399) 0:00:03.528 ******** 2026-03-19 17:27:33,581 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:33,590 p=37082 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-index-gateway pod is Running in openstack namespace] *** 2026-03-19 17:27:33,590 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:33 +0000 (0:00:00.484) 0:00:04.013 ******** 2026-03-19 17:27:33,983 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:33,991 p=37082 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-19 17:27:33,991 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:33 +0000 (0:00:00.400) 0:00:04.414 ******** 2026-03-19 17:27:34,390 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:34,402 p=37082 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-ingester pod is Running in openstack namespace] *** 2026-03-19 17:27:34,402 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:34 +0000 (0:00:00.411) 0:00:04.825 ******** 2026-03-19 17:27:34,720 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:34,728 p=37082 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-19 17:27:34,728 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:34 +0000 (0:00:00.326) 0:00:05.151 ******** 2026-03-19 17:27:35,151 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:35,159 p=37082 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-querier pod is Running in openstack namespace] *** 2026-03-19 17:27:35,159 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:35 +0000 (0:00:00.430) 0:00:05.582 ******** 2026-03-19 17:27:35,645 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:35,652 p=37082 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-19 17:27:35,652 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:35 +0000 (0:00:00.492) 0:00:06.075 ******** 2026-03-19 17:27:36,015 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:36,023 p=37082 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-query-frontend pod is Running in openstack namespace] *** 2026-03-19 17:27:36,023 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:36 +0000 (0:00:00.371) 0:00:06.446 ******** 2026-03-19 17:27:36,364 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:36,371 p=37082 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-19 17:27:36,372 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:36 +0000 (0:00:00.348) 0:00:06.794 ******** 2026-03-19 17:27:36,772 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:36,779 p=37082 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-proc pod is Running in openstack namespace] *** 2026-03-19 17:27:36,780 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:36 +0000 (0:00:00.408) 0:00:07.202 ******** 2026-03-19 17:27:37,104 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:37,112 p=37082 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-19 17:27:37,112 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:37 +0000 (0:00:00.332) 0:00:07.535 ******** 2026-03-19 17:27:37,125 p=37082 u=zuul n=ansible | skipping: [localhost] 2026-03-19 17:27:37,132 p=37082 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-19 17:27:37,132 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:37 +0000 (0:00:00.020) 0:00:07.555 ******** 2026-03-19 17:27:37,161 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for localhost => (item=['cloudkitty', 'rating', 'public']) 2026-03-19 17:27:37,163 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for localhost => (item=['cloudkitty', 'rating', 'internal']) 2026-03-19 17:27:37,184 p=37082 u=zuul n=ansible | TASK [common : Verify endpoint "['cloudkitty', 'rating', 'public']"] *********** 2026-03-19 17:27:37,184 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:37 +0000 (0:00:00.051) 0:00:07.607 ******** 2026-03-19 17:27:39,517 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:39,533 p=37082 u=zuul n=ansible | TASK [common : TEST Check that cloudkitty public endpoint exists] ************** 2026-03-19 17:27:39,533 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:39 +0000 (0:00:02.349) 0:00:09.956 ******** 2026-03-19 17:27:39,558 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "The endpoint cloudkitty is found." } 2026-03-19 17:27:39,568 p=37082 u=zuul n=ansible | TASK [common : Verify endpoint "['cloudkitty', 'rating', 'internal']"] ********* 2026-03-19 17:27:39,568 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:39 +0000 (0:00:00.034) 0:00:09.991 ******** 2026-03-19 17:27:41,899 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:41,920 p=37082 u=zuul n=ansible | TASK [common : TEST Check that cloudkitty internal endpoint exists] ************ 2026-03-19 17:27:41,920 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:41 +0000 (0:00:02.352) 0:00:12.343 ******** 2026-03-19 17:27:41,953 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "The endpoint cloudkitty is found." } 2026-03-19 17:27:41,963 p=37082 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-19 17:27:41,964 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:41 +0000 (0:00:00.043) 0:00:12.386 ******** 2026-03-19 17:27:42,010 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for localhost => (item=openstack) 2026-03-19 17:27:42,013 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for localhost => (item=openstack-operators) 2026-03-19 17:27:42,043 p=37082 u=zuul n=ansible | TASK [common : Get the openstack project] ************************************** 2026-03-19 17:27:42,043 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:42 +0000 (0:00:00.079) 0:00:12.466 ******** 2026-03-19 17:27:42,381 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:42,389 p=37082 u=zuul n=ansible | TASK [common : TEST Verify openstack project exists] *************************** 2026-03-19 17:27:42,390 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:42 +0000 (0:00:00.346) 0:00:12.812 ******** 2026-03-19 17:27:42,407 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "project openstack is found." } 2026-03-19 17:27:42,415 p=37082 u=zuul n=ansible | TASK [common : Get the openstack-operators project] **************************** 2026-03-19 17:27:42,415 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:42 +0000 (0:00:00.025) 0:00:12.838 ******** 2026-03-19 17:27:42,774 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:42,785 p=37082 u=zuul n=ansible | TASK [common : TEST Verify openstack-operators project exists] ***************** 2026-03-19 17:27:42,785 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:42 +0000 (0:00:00.369) 0:00:13.208 ******** 2026-03-19 17:27:42,806 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "project openstack-operators is found." } 2026-03-19 17:27:42,812 p=37082 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-19 17:27:42,812 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:42 +0000 (0:00:00.027) 0:00:13.235 ******** 2026-03-19 17:27:42,921 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-internal) 2026-03-19 17:27:42,924 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-compactor-grpc) 2026-03-19 17:27:42,926 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-compactor-http) 2026-03-19 17:27:42,928 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-distributor-grpc) 2026-03-19 17:27:42,930 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-distributor-http) 2026-03-19 17:27:42,932 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-gateway-http) 2026-03-19 17:27:42,935 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-gossip-ring) 2026-03-19 17:27:42,937 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway-grpc) 2026-03-19 17:27:42,939 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway-http) 2026-03-19 17:27:42,941 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-ingester-grpc) 2026-03-19 17:27:42,943 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-ingester-http) 2026-03-19 17:27:42,945 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-querier-grpc) 2026-03-19 17:27:42,947 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-querier-http) 2026-03-19 17:27:42,949 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend-grpc) 2026-03-19 17:27:42,950 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend-http) 2026-03-19 17:27:42,953 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-public) 2026-03-19 17:27:42,978 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-internal"] ************************* 2026-03-19 17:27:42,978 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:42 +0000 (0:00:00.166) 0:00:13.401 ******** 2026-03-19 17:27:43,372 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:43,380 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-internal service is running in openstack namespace] *** 2026-03-19 17:27:43,380 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:43 +0000 (0:00:00.401) 0:00:13.803 ******** 2026-03-19 17:27:43,397 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-internal is running." } 2026-03-19 17:27:43,405 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-compactor-grpc"] ********* 2026-03-19 17:27:43,405 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:43 +0000 (0:00:00.025) 0:00:13.828 ******** 2026-03-19 17:27:43,763 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:43,770 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-compactor-grpc service is running in openstack namespace] *** 2026-03-19 17:27:43,771 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:43 +0000 (0:00:00.365) 0:00:14.193 ******** 2026-03-19 17:27:43,789 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-compactor-grpc is running." } 2026-03-19 17:27:43,797 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-compactor-http"] ********* 2026-03-19 17:27:43,797 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:43 +0000 (0:00:00.026) 0:00:14.220 ******** 2026-03-19 17:27:44,141 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:44,148 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-compactor-http service is running in openstack namespace] *** 2026-03-19 17:27:44,148 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:44 +0000 (0:00:00.351) 0:00:14.571 ******** 2026-03-19 17:27:44,165 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-compactor-http is running." } 2026-03-19 17:27:44,173 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-distributor-grpc"] ******* 2026-03-19 17:27:44,173 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:44 +0000 (0:00:00.025) 0:00:14.596 ******** 2026-03-19 17:27:44,489 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:44,496 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-distributor-grpc service is running in openstack namespace] *** 2026-03-19 17:27:44,497 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:44 +0000 (0:00:00.323) 0:00:14.919 ******** 2026-03-19 17:27:44,513 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-distributor-grpc is running." } 2026-03-19 17:27:44,521 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-distributor-http"] ******* 2026-03-19 17:27:44,521 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:44 +0000 (0:00:00.024) 0:00:14.944 ******** 2026-03-19 17:27:44,850 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:44,858 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-distributor-http service is running in openstack namespace] *** 2026-03-19 17:27:44,858 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:44 +0000 (0:00:00.337) 0:00:15.281 ******** 2026-03-19 17:27:44,876 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-distributor-http is running." } 2026-03-19 17:27:44,883 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-gateway-http"] *********** 2026-03-19 17:27:44,883 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:44 +0000 (0:00:00.025) 0:00:15.306 ******** 2026-03-19 17:27:45,210 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:45,218 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-gateway-http service is running in openstack namespace] *** 2026-03-19 17:27:45,218 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:45 +0000 (0:00:00.334) 0:00:15.641 ******** 2026-03-19 17:27:45,236 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-gateway-http is running." } 2026-03-19 17:27:45,244 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-gossip-ring"] ************ 2026-03-19 17:27:45,244 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:45 +0000 (0:00:00.026) 0:00:15.667 ******** 2026-03-19 17:27:45,555 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:45,563 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-gossip-ring service is running in openstack namespace] *** 2026-03-19 17:27:45,563 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:45 +0000 (0:00:00.318) 0:00:15.986 ******** 2026-03-19 17:27:45,580 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-gossip-ring is running." } 2026-03-19 17:27:45,590 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-index-gateway-grpc"] ***** 2026-03-19 17:27:45,590 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:45 +0000 (0:00:00.027) 0:00:16.013 ******** 2026-03-19 17:27:45,945 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:45,961 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-index-gateway-grpc service is running in openstack namespace] *** 2026-03-19 17:27:45,962 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:45 +0000 (0:00:00.371) 0:00:16.385 ******** 2026-03-19 17:27:45,980 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-index-gateway-grpc is running." } 2026-03-19 17:27:45,987 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-index-gateway-http"] ***** 2026-03-19 17:27:45,987 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:45 +0000 (0:00:00.025) 0:00:16.410 ******** 2026-03-19 17:27:46,319 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:46,326 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-index-gateway-http service is running in openstack namespace] *** 2026-03-19 17:27:46,326 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:46 +0000 (0:00:00.338) 0:00:16.749 ******** 2026-03-19 17:27:46,343 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-index-gateway-http is running." } 2026-03-19 17:27:46,350 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-ingester-grpc"] ********** 2026-03-19 17:27:46,350 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:46 +0000 (0:00:00.024) 0:00:16.773 ******** 2026-03-19 17:27:46,711 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:46,719 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-ingester-grpc service is running in openstack namespace] *** 2026-03-19 17:27:46,719 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:46 +0000 (0:00:00.368) 0:00:17.142 ******** 2026-03-19 17:27:46,735 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-ingester-grpc is running." } 2026-03-19 17:27:46,743 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-ingester-http"] ********** 2026-03-19 17:27:46,743 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:46 +0000 (0:00:00.023) 0:00:17.166 ******** 2026-03-19 17:27:47,081 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:47,088 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-ingester-http service is running in openstack namespace] *** 2026-03-19 17:27:47,089 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:47 +0000 (0:00:00.345) 0:00:17.511 ******** 2026-03-19 17:27:47,107 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-ingester-http is running." } 2026-03-19 17:27:47,115 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-querier-grpc"] *********** 2026-03-19 17:27:47,115 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:47 +0000 (0:00:00.026) 0:00:17.538 ******** 2026-03-19 17:27:47,463 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:47,471 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-querier-grpc service is running in openstack namespace] *** 2026-03-19 17:27:47,472 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:47 +0000 (0:00:00.356) 0:00:17.894 ******** 2026-03-19 17:27:47,490 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-querier-grpc is running." } 2026-03-19 17:27:47,497 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-querier-http"] *********** 2026-03-19 17:27:47,498 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:47 +0000 (0:00:00.025) 0:00:17.920 ******** 2026-03-19 17:27:47,818 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:47,825 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-querier-http service is running in openstack namespace] *** 2026-03-19 17:27:47,825 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:47 +0000 (0:00:00.327) 0:00:18.248 ******** 2026-03-19 17:27:47,842 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-querier-http is running." } 2026-03-19 17:27:47,850 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-query-frontend-grpc"] **** 2026-03-19 17:27:47,850 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:47 +0000 (0:00:00.024) 0:00:18.273 ******** 2026-03-19 17:27:48,191 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:48,199 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-query-frontend-grpc service is running in openstack namespace] *** 2026-03-19 17:27:48,199 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:48 +0000 (0:00:00.349) 0:00:18.622 ******** 2026-03-19 17:27:48,217 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-query-frontend-grpc is running." } 2026-03-19 17:27:48,224 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-query-frontend-http"] **** 2026-03-19 17:27:48,224 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:48 +0000 (0:00:00.025) 0:00:18.647 ******** 2026-03-19 17:27:48,584 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:48,592 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-query-frontend-http service is running in openstack namespace] *** 2026-03-19 17:27:48,592 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:48 +0000 (0:00:00.367) 0:00:19.015 ******** 2026-03-19 17:27:48,609 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-query-frontend-http is running." } 2026-03-19 17:27:48,616 p=37082 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-public"] *************************** 2026-03-19 17:27:48,616 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:48 +0000 (0:00:00.024) 0:00:19.039 ******** 2026-03-19 17:27:48,981 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:48,988 p=37082 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-public service is running in openstack namespace] *** 2026-03-19 17:27:48,989 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:48 +0000 (0:00:00.372) 0:00:19.411 ******** 2026-03-19 17:27:49,005 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-public is running." } 2026-03-19 17:27:49,013 p=37082 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-19 17:27:49,013 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:49 +0000 (0:00:00.024) 0:00:19.436 ******** 2026-03-19 17:27:49,029 p=37082 u=zuul n=ansible | skipping: [localhost] 2026-03-19 17:27:49,036 p=37082 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-19 17:27:49,036 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:49 +0000 (0:00:00.022) 0:00:19.459 ******** 2026-03-19 17:27:49,052 p=37082 u=zuul n=ansible | skipping: [localhost] 2026-03-19 17:27:49,058 p=37082 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-19 17:27:49,058 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:49 +0000 (0:00:00.022) 0:00:19.481 ******** 2026-03-19 17:27:49,074 p=37082 u=zuul n=ansible | skipping: [localhost] 2026-03-19 17:27:49,081 p=37082 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-19 17:27:49,081 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:49 +0000 (0:00:00.022) 0:00:19.504 ******** 2026-03-19 17:27:49,096 p=37082 u=zuul n=ansible | skipping: [localhost] 2026-03-19 17:27:49,102 p=37082 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-19 17:27:49,102 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:49 +0000 (0:00:00.021) 0:00:19.525 ******** 2026-03-19 17:27:49,117 p=37082 u=zuul n=ansible | skipping: [localhost] 2026-03-19 17:27:49,124 p=37082 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-19 17:27:49,124 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:49 +0000 (0:00:00.021) 0:00:19.547 ******** 2026-03-19 17:27:49,139 p=37082 u=zuul n=ansible | skipping: [localhost] 2026-03-19 17:27:49,152 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Validate Chargeback Feature deployed correctly] *** 2026-03-19 17:27:49,152 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:49 +0000 (0:00:00.027) 0:00:19.575 ******** 2026-03-19 17:27:49,192 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/chargeback_tests.yml for localhost 2026-03-19 17:27:49,200 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Enable Cloudkitty Module (hashmap)] *************** 2026-03-19 17:27:49,200 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:49 +0000 (0:00:00.048) 0:00:19.623 ******** 2026-03-19 17:27:52,960 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:27:52,966 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Find the current value of hashmap] **************** 2026-03-19 17:27:52,966 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:52 +0000 (0:00:03.765) 0:00:23.389 ******** 2026-03-19 17:27:55,879 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:27:55,887 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Change priority for CloudKitty hashmap module] **** 2026-03-19 17:27:55,887 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:55 +0000 (0:00:02.921) 0:00:26.310 ******** 2026-03-19 17:27:59,278 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:27:59,293 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Get status of all CloudKitty rating modules] ****** 2026-03-19 17:27:59,293 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:27:59 +0000 (0:00:03.405) 0:00:29.716 ******** 2026-03-19 17:28:02,044 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:02,061 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Validate CloudKitty module states] *********** 2026-03-19 17:28:02,061 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:02 +0000 (0:00:02.768) 0:00:32.484 ******** 2026-03-19 17:28:02,090 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "SUCCESS: CloudKitty modules (hashmap=True) are configured correctly." } 2026-03-19 17:28:02,104 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Set priority for CloudKitty hashmap module] *** 2026-03-19 17:28:02,104 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:02 +0000 (0:00:00.042) 0:00:32.527 ******** 2026-03-19 17:28:02,131 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "SUCCESS: The hashmap priority is set to 100" } 2026-03-19 17:28:02,146 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Setup Loki Environment] *************************** 2026-03-19 17:28:02,147 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:02 +0000 (0:00:00.042) 0:00:32.569 ******** 2026-03-19 17:28:02,174 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/setup_loki_env.yml for localhost 2026-03-19 17:28:02,191 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Get Loki Public Route Host] *********************** 2026-03-19 17:28:02,191 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:02 +0000 (0:00:00.044) 0:00:32.614 ******** 2026-03-19 17:28:02,534 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:02,541 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Set Loki URLs] ************************************ 2026-03-19 17:28:02,541 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:02 +0000 (0:00:00.350) 0:00:32.964 ******** 2026-03-19 17:28:02,556 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:02,563 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Set Derived Loki URLs] **************************** 2026-03-19 17:28:02,563 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:02 +0000 (0:00:00.022) 0:00:32.986 ******** 2026-03-19 17:28:02,579 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:02,585 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Debug URLs] *************************************** 2026-03-19 17:28:02,586 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:02 +0000 (0:00:00.022) 0:00:33.008 ******** 2026-03-19 17:28:02,601 p=37082 u=zuul n=ansible | ok: [localhost] => { "msg": [ "Loki Route: https://cloudkitty-lokistack-openstack.apps-crc.testing", "Push URL: https://cloudkitty-lokistack-openstack.apps-crc.testing/api/logs/v1/cloudkitty/loki/api/v1/push", "Flush URL: https://cloudkitty-lokistack-ingester-http.openstack.svc:3100/flush", "Query URL: https://cloudkitty-lokistack-openstack.apps-crc.testing/api/logs/v1/cloudkitty/loki/api/v1/query_range" ] } 2026-03-19 17:28:02,608 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Ensure Local Certificate Directory Exists] ******** 2026-03-19 17:28:02,608 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:02 +0000 (0:00:00.022) 0:00:33.031 ******** 2026-03-19 17:28:02,906 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:28:02,913 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Extract Certificates from Openshift Secret] ******* 2026-03-19 17:28:02,913 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:02 +0000 (0:00:00.305) 0:00:33.336 ******** 2026-03-19 17:28:03,208 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:28:03,214 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Extract Client Certificates] ********************** 2026-03-19 17:28:03,215 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:03 +0000 (0:00:00.301) 0:00:33.637 ******** 2026-03-19 17:28:03,514 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:28:03,521 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Extract CA Bundle] ******************************** 2026-03-19 17:28:03,521 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:03 +0000 (0:00:00.306) 0:00:33.944 ******** 2026-03-19 17:28:03,692 p=37082 u=zuul n=ansible | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: ValueError: No closing quotation 2026-03-19 17:28:03,693 p=37082 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": true, "module_stderr": "Traceback (most recent call last):\n File \"/home/zuul/.ansible/tmp/ansible-tmp-1773941283.538732-38219-153706689855057/AnsiballZ_command.py\", line 107, in \n _ansiballz_main()\n File \"/home/zuul/.ansible/tmp/ansible-tmp-1773941283.538732-38219-153706689855057/AnsiballZ_command.py\", line 99, in _ansiballz_main\n invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS)\n File \"/home/zuul/.ansible/tmp/ansible-tmp-1773941283.538732-38219-153706689855057/AnsiballZ_command.py\", line 47, in invoke_module\n runpy.run_module(mod_name='ansible.modules.command', init_globals=dict(_module_fqn='ansible.modules.command', _modlib_path=modlib_path),\n File \"/usr/lib64/python3.9/runpy.py\", line 225, in run_module\n return _run_module_code(code, init_globals, run_name, mod_spec)\n File \"/usr/lib64/python3.9/runpy.py\", line 97, in _run_module_code\n _run_code(code, mod_globals, init_globals,\n File \"/usr/lib64/python3.9/runpy.py\", line 87, in _run_code\n exec(code, run_globals)\n File \"/tmp/ansible_ansible.legacy.command_payload_y9ht34zl/ansible_ansible.legacy.command_payload.zip/ansible/modules/command.py\", line 354, in \n File \"/tmp/ansible_ansible.legacy.command_payload_y9ht34zl/ansible_ansible.legacy.command_payload.zip/ansible/modules/command.py\", line 276, in main\n File \"/usr/lib64/python3.9/shlex.py\", line 315, in split\n return list(lex)\n File \"/usr/lib64/python3.9/shlex.py\", line 300, in __next__\n token = self.get_token()\n File \"/usr/lib64/python3.9/shlex.py\", line 109, in get_token\n raw = self.read_token()\n File \"/usr/lib64/python3.9/shlex.py\", line 191, in read_token\n raise ValueError(\"No closing quotation\")\nValueError: No closing quotation\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1} 2026-03-19 17:28:03,693 p=37082 u=zuul n=ansible | ...ignoring 2026-03-19 17:28:03,700 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Cloudkitty debug ON] ****************************** 2026-03-19 17:28:03,700 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:03 +0000 (0:00:00.178) 0:00:34.123 ******** 2026-03-19 17:28:03,710 p=37082 u=zuul n=ansible | skipping: [localhost] 2026-03-19 17:28:03,717 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Cloudkitty debug OFF] ***************************** 2026-03-19 17:28:03,717 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:03 +0000 (0:00:00.017) 0:00:34.140 ******** 2026-03-19 17:28:03,730 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:03,737 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Get admin project ID for CI] ********************** 2026-03-19 17:28:03,737 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:03 +0000 (0:00:00.019) 0:00:34.160 ******** 2026-03-19 17:28:05,990 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:05,998 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Set admin project ID for CI] ********************** 2026-03-19 17:28:05,998 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:05 +0000 (0:00:02.261) 0:00:36.421 ******** 2026-03-19 17:28:06,016 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:06,024 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Get admin user ID for CI] ************************* 2026-03-19 17:28:06,024 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:06 +0000 (0:00:00.025) 0:00:36.447 ******** 2026-03-19 17:28:08,249 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:08,257 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Set admin user ID for CI] ************************* 2026-03-19 17:28:08,257 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:08 +0000 (0:00:02.232) 0:00:38.680 ******** 2026-03-19 17:28:08,276 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:08,285 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Find test files] ********************************** 2026-03-19 17:28:08,285 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:08 +0000 (0:00:00.027) 0:00:38.708 ******** 2026-03-19 17:28:08,594 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:08,603 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Extract only the filenames into a clean list] ***** 2026-03-19 17:28:08,604 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:08 +0000 (0:00:00.318) 0:00:39.026 ******** 2026-03-19 17:28:08,622 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:08,632 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Process and Loop if files exist] ****************** 2026-03-19 17:28:08,632 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:08 +0000 (0:00:00.028) 0:00:39.055 ******** 2026-03-19 17:28:08,668 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/run_test_scenarios.yml for localhost => (item=test_dyn_basic) 2026-03-19 17:28:08,680 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Generate Synthetic Data for each file: test_dyn_basic] *** 2026-03-19 17:28:08,681 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:08 +0000 (0:00:00.048) 0:00:39.104 ******** 2026-03-19 17:28:08,700 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/gen_synth_loki_data.yml for localhost 2026-03-19 17:28:08,710 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Set variables dynamically "test_dyn_basic"] ******* 2026-03-19 17:28:08,711 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:08 +0000 (0:00:00.029) 0:00:39.133 ******** 2026-03-19 17:28:08,728 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:08,734 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Check for preexisting output file] **************** 2026-03-19 17:28:08,735 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:08 +0000 (0:00:00.023) 0:00:39.157 ******** 2026-03-19 17:28:09,045 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:09,056 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Generate Synthetic Data "test_dyn_basic"] ********* 2026-03-19 17:28:09,056 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:09 +0000 (0:00:00.321) 0:00:39.479 ******** 2026-03-19 17:28:09,356 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:28:09,364 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Generate chargeback rating from synthetic data file "test_dyn_basic"] *** 2026-03-19 17:28:09,364 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:09 +0000 (0:00:00.307) 0:00:39.787 ******** 2026-03-19 17:28:09,617 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:28:09,627 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Load metrics from YAML file] ********************** 2026-03-19 17:28:09,628 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:09 +0000 (0:00:00.263) 0:00:40.051 ******** 2026-03-19 17:28:09,644 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:09,654 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Load data to loki: test_dyn_basic] **************** 2026-03-19 17:28:09,654 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:09 +0000 (0:00:00.026) 0:00:40.077 ******** 2026-03-19 17:28:09,679 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/load_loki_data.yml for localhost 2026-03-19 17:28:09,694 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Ingests Cloudkitty Data log "test_dyn_basic"] ***** 2026-03-19 17:28:09,694 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:09 +0000 (0:00:00.040) 0:00:40.117 ******** 2026-03-19 17:28:09,715 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/ingest_loki_data.yml for localhost 2026-03-19 17:28:09,724 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Read log file content] **************************** 2026-03-19 17:28:09,724 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:09 +0000 (0:00:00.029) 0:00:40.147 ******** 2026-03-19 17:28:10,020 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:10,027 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Push data to Loki] ******************************** 2026-03-19 17:28:10,027 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:10 +0000 (0:00:00.302) 0:00:40.450 ******** 2026-03-19 17:28:10,831 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:10,840 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Confirm Success] ********************************** 2026-03-19 17:28:10,840 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:10 +0000 (0:00:00.812) 0:00:41.263 ******** 2026-03-19 17:28:10,865 p=37082 u=zuul n=ansible | ok: [localhost] => { "msg": "Ingestion Successful!" } 2026-03-19 17:28:10,873 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Flush Data to loki Storage " test_dyn_basic"] ***** 2026-03-19 17:28:10,873 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:10 +0000 (0:00:00.032) 0:00:41.296 ******** 2026-03-19 17:28:10,894 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/flush_loki_data.yml for localhost 2026-03-19 17:28:10,908 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Create directory inside openstack CLI] ************ 2026-03-19 17:28:10,908 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:10 +0000 (0:00:00.035) 0:00:41.331 ******** 2026-03-19 17:28:11,366 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:11,382 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Create a directory to extract certificates] ******* 2026-03-19 17:28:11,382 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:11 +0000 (0:00:00.473) 0:00:41.805 ******** 2026-03-19 17:28:11,593 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:28:11,602 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Copy certificates to openstack CLI] *************** 2026-03-19 17:28:11,603 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:11 +0000 (0:00:00.220) 0:00:42.026 ******** 2026-03-19 17:28:12,124 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:28:12,133 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Trigger Flush] ************************************ 2026-03-19 17:28:12,133 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:12 +0000 (0:00:00.529) 0:00:42.556 ******** 2026-03-19 17:28:12,550 p=37082 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["oc", "exec", "-n", "openstack", "openstackclient", "--", "curl", "-v", "-X", "POST", "https://cloudkitty-lokistack-ingester-http.openstack.svc:3100/flush", "--cert", "osp-certs/tls.crt", "--key", "osp-certs/tls.key", "--cacert", "osp-certs/service-ca.crt"], "delta": "0:00:00.230593", "end": "2026-03-19 17:28:12.524916", "failed_when_result": true, "msg": "non-zero return code", "rc": 77, "start": "2026-03-19 17:28:12.294323", "stderr": " % Total % Received % Xferd Average Speed Time Time Time Current\n Dload Upload Total Spent Left Speed\n\r 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Trying 10.217.5.211:3100...\n* Connected to cloudkitty-lokistack-ingester-http.openstack.svc (10.217.5.211) port 3100 (#0)\n* ALPN, offering h2\n* ALPN, offering http/1.1\n* error setting certificate file: osp-certs/service-ca.crt\n\r 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0\n* Closing connection 0\ncurl: (77) error setting certificate file: osp-certs/service-ca.crt\ncommand terminated with exit code 77", "stderr_lines": [" % Total % Received % Xferd Average Speed Time Time Time Current", " Dload Upload Total Spent Left Speed", "", " 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Trying 10.217.5.211:3100...", "* Connected to cloudkitty-lokistack-ingester-http.openstack.svc (10.217.5.211) port 3100 (#0)", "* ALPN, offering h2", "* ALPN, offering http/1.1", "* error setting certificate file: osp-certs/service-ca.crt", "", " 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0", "* Closing connection 0", "curl: (77) error setting certificate file: osp-certs/service-ca.crt", "command terminated with exit code 77"], "stdout": "", "stdout_lines": []} 2026-03-19 17:28:12,550 p=37082 u=zuul n=ansible | ...ignoring 2026-03-19 17:28:12,557 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Verify Flush Status] ****************************** 2026-03-19 17:28:12,558 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:12 +0000 (0:00:00.424) 0:00:42.980 ******** 2026-03-19 17:28:12,573 p=37082 u=zuul n=ansible | fatal: [localhost]: FAILED! => { "assertion": "'204' in flush_response.stderr or '200' in flush_response.stderr", "changed": false, "evaluated_to": false, "msg": "Flush failed" } 2026-03-19 17:28:12,574 p=37082 u=zuul n=ansible | ...ignoring 2026-03-19 17:28:12,581 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Retrieve Data log from loki "test_dyn_basic"] ***** 2026-03-19 17:28:12,581 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:12 +0000 (0:00:00.023) 0:00:43.004 ******** 2026-03-19 17:28:12,602 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/retrieve_loki_data.yml for localhost 2026-03-19 17:28:12,621 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Expected Count test_dyn_basic] ******************** 2026-03-19 17:28:12,622 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:12 +0000 (0:00:00.040) 0:00:43.045 ******** 2026-03-19 17:28:12,638 p=37082 u=zuul n=ansible | ok: [localhost] => { "msg": "Input file has 42 data entries that Loki has to return" } 2026-03-19 17:28:12,644 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Query Loki API] *********************************** 2026-03-19 17:28:12,645 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:28:12 +0000 (0:00:00.022) 0:00:43.067 ******** 2026-03-19 17:53:25,580 p=37082 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"attempts": 25, "changed": false, "connection": "close", "content": "{\"status\":\"success\",\"data\":{\"resultType\":\"streams\",\"result\":[],\"stats\":{\"summary\":{\"bytesProcessedPerSecond\":0,\"linesProcessedPerSecond\":0,\"totalBytesProcessed\":0,\"totalLinesProcessed\":0,\"execTime\":0.092948,\"queueTime\":0,\"subqueries\":0,\"totalEntriesReturned\":0,\"splits\":50,\"shards\":50,\"totalPostFilterLines\":0,\"totalStructuredMetadataBytesProcessed\":0},\"querier\":{\"store\":{\"totalChunksRef\":0,\"totalChunksDownloaded\":0,\"chunksDownloadTime\":0,\"queryReferencedStructuredMetadata\":false,\"chunk\":{\"headChunkBytes\":0,\"headChunkLines\":0,\"decompressedBytes\":0,\"decompressedLines\":0,\"compressedBytes\":0,\"totalDuplicates\":0,\"postFilterLines\":0,\"headChunkStructuredMetadataBytes\":0,\"decompressedStructuredMetadataBytes\":0},\"chunkRefsFetchTime\":31298800,\"congestionControlLatency\":0,\"pipelineWrapperFilteredLines\":0}},\"ingester\":{\"totalReached\":7,\"totalChunksMatched\":0,\"totalBatches\":7,\"totalLinesSent\":0,\"store\":{\"totalChunksRef\":0,\"totalChunksDownloaded\":0,\"chunksDownloadTime\":0,\"queryReferencedStructuredMetadata\":false,\"chunk\":{\"headChunkBytes\":0,\"headChunkLines\":0,\"decompressedBytes\":0,\"decompressedLines\":0,\"compressedBytes\":0,\"totalDuplicates\":0,\"postFilterLines\":0,\"headChunkStructuredMetadataBytes\":0,\"decompressedStructuredMetadataBytes\":0},\"chunkRefsFetchTime\":0,\"congestionControlLatency\":0,\"pipelineWrapperFilteredLines\":0}},\"cache\":{\"chunk\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"index\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"result\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"statsResult\":{\"entriesFound\":50,\"entriesRequested\":50,\"entriesStored\":0,\"bytesReceived\":11150,\"bytesSent\":0,\"requests\":50,\"downloadTime\":268641,\"queryLengthServed\":87980000000000},\"volumeResult\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"seriesResult\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"labelResult\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"instantMetricResult\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0}},\"index\":{\"totalChunks\":0,\"postFilterChunks\":0,\"shardsDuration\":0,\"usedBloomFilters\":false}}}}\n", "content_type": "application/json; charset=UTF-8", "cookies": {}, "cookies_string": "", "date": "Thu, 19 Mar 2026 17:53:25 GMT", "elapsed": 0, "json": {"data": {"result": [], "resultType": "streams", "stats": {"cache": {"chunk": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "index": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "instantMetricResult": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "labelResult": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "result": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "seriesResult": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "statsResult": {"bytesReceived": 11150, "bytesSent": 0, "downloadTime": 268641, "entriesFound": 50, "entriesRequested": 50, "entriesStored": 0, "queryLengthServed": 87980000000000, "requests": 50}, "volumeResult": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}}, "index": {"postFilterChunks": 0, "shardsDuration": 0, "totalChunks": 0, "usedBloomFilters": false}, "ingester": {"store": {"chunk": {"compressedBytes": 0, "decompressedBytes": 0, "decompressedLines": 0, "decompressedStructuredMetadataBytes": 0, "headChunkBytes": 0, "headChunkLines": 0, "headChunkStructuredMetadataBytes": 0, "postFilterLines": 0, "totalDuplicates": 0}, "chunkRefsFetchTime": 0, "chunksDownloadTime": 0, "congestionControlLatency": 0, "pipelineWrapperFilteredLines": 0, "queryReferencedStructuredMetadata": false, "totalChunksDownloaded": 0, "totalChunksRef": 0}, "totalBatches": 7, "totalChunksMatched": 0, "totalLinesSent": 0, "totalReached": 7}, "querier": {"store": {"chunk": {"compressedBytes": 0, "decompressedBytes": 0, "decompressedLines": 0, "decompressedStructuredMetadataBytes": 0, "headChunkBytes": 0, "headChunkLines": 0, "headChunkStructuredMetadataBytes": 0, "postFilterLines": 0, "totalDuplicates": 0}, "chunkRefsFetchTime": 31298800, "chunksDownloadTime": 0, "congestionControlLatency": 0, "pipelineWrapperFilteredLines": 0, "queryReferencedStructuredMetadata": false, "totalChunksDownloaded": 0, "totalChunksRef": 0}}, "summary": {"bytesProcessedPerSecond": 0, "execTime": 0.092948, "linesProcessedPerSecond": 0, "queueTime": 0, "shards": 50, "splits": 50, "subqueries": 0, "totalBytesProcessed": 0, "totalEntriesReturned": 0, "totalLinesProcessed": 0, "totalPostFilterLines": 0, "totalStructuredMetadataBytesProcessed": 0}}}, "status": "success"}, "msg": "OK (unknown bytes)", "redirected": false, "status": 200, "transfer_encoding": "chunked", "url": "https://cloudkitty-lokistack-openstack.apps-crc.testing/api/logs/v1/cloudkitty/loki/api/v1/query_range?query=%7Bservice%3D%22cloudkitty%22%7D&start=1773854889000000000&limit=50", "vary": "Accept-Encoding"} 2026-03-19 17:53:25,580 p=37082 u=zuul n=ansible | ...ignoring 2026-03-19 17:53:25,595 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Save Loki Data to JSON file] ********************** 2026-03-19 17:53:25,595 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:25 +0000 (0:25:12.950) 0:25:56.018 ******** 2026-03-19 17:53:26,119 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:53:26,128 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Verify Data Integrity test_dyn_basic] ************* 2026-03-19 17:53:26,128 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:26 +0000 (0:00:00.532) 0:25:56.551 ******** 2026-03-19 17:53:26,154 p=37082 u=zuul n=ansible | fatal: [localhost]: FAILED! => { "assertion": "loki_response.json.data.result | length > 0", "changed": false, "evaluated_to": false, "msg": "Query did not return all data entries. Expected 42 log entries, but Loki only returned 0" } 2026-03-19 17:53:26,154 p=37082 u=zuul n=ansible | ...ignoring 2026-03-19 17:53:26,162 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Generate chargeback stats from Loki-retrieved data file: test_dyn_basic] *** 2026-03-19 17:53:26,162 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:26 +0000 (0:00:00.034) 0:25:56.585 ******** 2026-03-19 17:53:26,392 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:53:26,400 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Get total rate from loki: test_dyn_basic] ********* 2026-03-19 17:53:26,400 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:26 +0000 (0:00:00.237) 0:25:56.823 ******** 2026-03-19 17:53:26,419 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/loki_rate.yml for localhost 2026-03-19 17:53:26,434 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Get Rate and Qty by type from Cloudkitty test_dyn_basic] *** 2026-03-19 17:53:26,434 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:26 +0000 (0:00:00.034) 0:25:56.857 ******** 2026-03-19 17:53:33,225 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:53:33,233 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : **INFO** Print the rating by type test_dyn_basic] *** 2026-03-19 17:53:33,233 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:33 +0000 (0:00:06.799) 0:26:03.656 ******** 2026-03-19 17:53:33,263 p=37082 u=zuul n=ansible | ok: [localhost] => { "cost_totals_by_type.stdout": "" } 2026-03-19 17:53:33,271 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Save output as a loadable variable file test_dyn_basic] *** 2026-03-19 17:53:33,271 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:33 +0000 (0:00:00.038) 0:26:03.694 ******** 2026-03-19 17:53:33,712 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:53:33,720 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Get Rate and Qty Summary from Cloudkitty test_dyn_basic] *** 2026-03-19 17:53:33,720 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:33 +0000 (0:00:00.448) 0:26:04.143 ******** 2026-03-19 17:53:39,991 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:53:40,004 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : **INFO** Print the rating summary test_dyn_basic] *** 2026-03-19 17:53:40,004 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:40 +0000 (0:00:06.284) 0:26:10.427 ******** 2026-03-19 17:53:40,025 p=37082 u=zuul n=ansible | ok: [localhost] => { "cost_totals_summary.stdout": "+---------------------------+---------------------------+-----+------+\n| Begin | End | Qty | Rate |\n+---------------------------+---------------------------+-----+------+\n| 2026-03-01T00:00:00+00:00 | 2026-04-01T00:00:00+00:00 | 0.0 | 0.0 |\n+---------------------------+---------------------------+-----+------+" } 2026-03-19 17:53:40,036 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Check synthetic totals file exists] *************** 2026-03-19 17:53:40,036 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:40 +0000 (0:00:00.032) 0:26:10.459 ******** 2026-03-19 17:53:40,251 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:53:40,257 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Check loki totals file exists] ******************** 2026-03-19 17:53:40,258 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:40 +0000 (0:00:00.221) 0:26:10.680 ******** 2026-03-19 17:53:40,454 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:53:40,461 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Totals files exist test_dyn_basic] *********** 2026-03-19 17:53:40,462 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:40 +0000 (0:00:00.204) 0:26:10.884 ******** 2026-03-19 17:53:40,485 p=37082 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "PASSED! Required file(s) exist test_dyn_basic: \n- /home/zuul/ci-framework-data/artifacts/test_dyn_basic-synth_metrics_summary.yml\n- /home/zuul/ci-framework-data/artifacts/test_dyn_basic-loki_metrics_summary.yml \n" } 2026-03-19 17:53:40,491 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Read the synthetic totals file] ******************* 2026-03-19 17:53:40,491 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:40 +0000 (0:00:00.029) 0:26:10.914 ******** 2026-03-19 17:53:40,687 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:53:40,694 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Read loki totals yaml file] *********************** 2026-03-19 17:53:40,694 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:40 +0000 (0:00:00.202) 0:26:11.117 ******** 2026-03-19 17:53:40,876 p=37082 u=zuul n=ansible | ok: [localhost] 2026-03-19 17:53:40,887 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Compare synthetic data vs loki data results test_dyn_basic] *** 2026-03-19 17:53:40,888 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:40 +0000 (0:00:00.193) 0:26:11.310 ******** 2026-03-19 17:53:40,910 p=37082 u=zuul n=ansible | fatal: [localhost]: FAILED! => { "assertion": "(synth_data.content | b64decode | from_yaml).data_log == (loki_data.content | b64decode | from_yaml).data_log", "changed": false, "evaluated_to": false, "msg": "FAILED! test_dyn_basic" } 2026-03-19 17:53:40,911 p=37082 u=zuul n=ansible | ...ignoring 2026-03-19 17:53:40,919 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Cleanup after job run] **************************** 2026-03-19 17:53:40,919 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:40 +0000 (0:00:00.031) 0:26:11.342 ******** 2026-03-19 17:53:40,942 p=37082 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/cleanup_ck.yml for localhost 2026-03-19 17:53:40,954 p=37082 u=zuul n=ansible | TASK [telemetry_chargeback : Cleanup local certificates] *********************** 2026-03-19 17:53:40,954 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:40 +0000 (0:00:00.034) 0:26:11.377 ******** 2026-03-19 17:53:41,168 p=37082 u=zuul n=ansible | changed: [localhost] 2026-03-19 17:53:41,194 p=37082 u=zuul n=ansible | PLAY RECAP ********************************************************************* 2026-03-19 17:53:41,194 p=37082 u=zuul n=ansible | localhost : ok=146 changed=16 unreachable=0 failed=0 skipped=8 rescued=0 ignored=6 2026-03-19 17:53:41,201 p=37082 u=zuul n=ansible | Thursday 19 March 2026 17:53:41 +0000 (0:00:00.247) 0:26:11.624 ******** 2026-03-19 17:53:41,201 p=37082 u=zuul n=ansible | =============================================================================== 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Query Loki API -------------------------------- 1512.95s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : TEST Get Rate and Qty by type from Cloudkitty test_dyn_basic --- 6.80s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : TEST Get Rate and Qty Summary from Cloudkitty test_dyn_basic --- 6.28s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Enable Cloudkitty Module (hashmap) --------------- 3.77s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Change priority for CloudKitty hashmap module ---- 3.41s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Find the current value of hashmap ---------------- 2.92s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Get status of all CloudKitty rating modules ------ 2.77s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : Verify endpoint "['cloudkitty', 'rating', 'internal']" --------- 2.35s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : Verify endpoint "['cloudkitty', 'rating', 'public']" ----------- 2.35s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Get admin project ID for CI ---------------------- 2.26s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Get admin user ID for CI ------------------------- 2.23s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 1.04s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Push data to Loki -------------------------------- 0.81s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Save Loki Data to JSON file ---------------------- 0.53s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Copy certificates to openstack CLI --------------- 0.53s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.49s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-querier pod is Running in openstack namespace --- 0.49s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.48s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Create directory inside openstack CLI ------------ 0.47s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Save output as a loadable variable file test_dyn_basic --- 0.45s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.43s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | telemetry_chargeback : Trigger Flush ------------------------------------ 0.42s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.41s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.41s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-internal" ------------------------- 0.40s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-index-gateway pod is Running in openstack namespace --- 0.40s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.40s 2026-03-19 17:53:41,202 p=37082 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-distributor pod is Running in openstack namespace --- 0.40s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-public" --------------------------- 0.37s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-index-gateway-grpc" ----- 0.37s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.37s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Get the openstack-operators project ---------------------------- 0.37s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-ingester-grpc" ---------- 0.37s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-query-frontend-http" ---- 0.37s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-compactor-grpc" --------- 0.37s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-querier-grpc" ----------- 0.36s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : TEST Check cloudkitty-api pod is Running in openstack namespace --- 0.35s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.35s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-compactor-http" --------- 0.35s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | telemetry_chargeback : Get Loki Public Route Host ----------------------- 0.35s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-query-frontend-grpc" ---- 0.35s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-query-frontend pod is Running in openstack namespace --- 0.35s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Get the openstack project -------------------------------------- 0.35s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-ingester-http" ---------- 0.35s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-index-gateway-http" ----- 0.34s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-distributor-http" ------- 0.34s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-gateway-http" ----------- 0.33s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : TEST Check cloudkitty-proc pod is Running in openstack namespace --- 0.33s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-querier-http" ----------- 0.33s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-compactor pod is Running in openstack namespace --- 0.33s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-ingester pod is Running in openstack namespace --- 0.33s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-distributor-grpc" ------- 0.32s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | telemetry_chargeback : Check for preexisting output file ---------------- 0.32s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | telemetry_chargeback : Find test files ---------------------------------- 0.32s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-gossip-ring" ------------ 0.32s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | telemetry_chargeback : Generate Synthetic Data "test_dyn_basic" --------- 0.31s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | telemetry_chargeback : Extract Client Certificates ---------------------- 0.31s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | telemetry_chargeback : Ensure Local Certificate Directory Exists -------- 0.31s 2026-03-19 17:53:41,203 p=37082 u=zuul n=ansible | telemetry_chargeback : Read log file content ---------------------------- 0.30s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Extract Certificates from Openshift Secret ------- 0.30s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Generate chargeback rating from synthetic data file "test_dyn_basic" --- 0.26s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Cleanup local certificates ----------------------- 0.25s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Generate chargeback stats from Loki-retrieved data file: test_dyn_basic --- 0.24s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Check synthetic totals file exists --------------- 0.22s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Create a directory to extract certificates ------- 0.22s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Check loki totals file exists -------------------- 0.20s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Read the synthetic totals file ------------------- 0.20s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Read loki totals yaml file ----------------------- 0.19s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Extract CA Bundle -------------------------------- 0.18s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.17s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.13s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.08s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.05s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Validate Chargeback Feature deployed correctly --- 0.05s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Process and Loop if files exist ------------------ 0.05s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Setup Loki Environment --------------------------- 0.04s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | common : TEST Check that cloudkitty internal endpoint exists ----------- 0.04s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : TEST Validate CloudKitty module states ----------- 0.04s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : TEST Set priority for CloudKitty hashmap module --- 0.04s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Retrieve Data log from loki "test_dyn_basic" ----- 0.04s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Load data to loki: test_dyn_basic ---------------- 0.04s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : **INFO** Print the rating by type test_dyn_basic --- 0.04s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Flush Data to loki Storage " test_dyn_basic" ----- 0.04s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Cleanup after job run ---------------------------- 0.03s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | common : TEST Check that cloudkitty public endpoint exists ------------- 0.03s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Get total rate from loki: test_dyn_basic --------- 0.03s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Verify Data Integrity test_dyn_basic ------------- 0.03s 2026-03-19 17:53:41,204 p=37082 u=zuul n=ansible | telemetry_chargeback : Confirm Success ---------------------------------- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | telemetry_chargeback : **INFO** Print the rating summary test_dyn_basic --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | telemetry_chargeback : TEST Compare synthetic data vs loki data results test_dyn_basic --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | telemetry_chargeback : Generate Synthetic Data for each file: test_dyn_basic --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | telemetry_chargeback : Ingests Cloudkitty Data log "test_dyn_basic" ----- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | telemetry_chargeback : TEST Totals files exist test_dyn_basic ----------- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | telemetry_chargeback : Extract only the filenames into a clean list ----- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | telemetry_chargeback : Set admin user ID for CI ------------------------- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-gossip-ring service is running in openstack namespace --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify openstack-operators project exists ---------------- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-ingester-http service is running in openstack namespace --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | telemetry_chargeback : Load metrics from YAML file ---------------------- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-compactor-grpc service is running in openstack namespace --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-gateway-http service is running in openstack namespace --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-querier-grpc service is running in openstack namespace --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | telemetry_chargeback : Set admin project ID for CI ---------------------- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify openstack project exists -------------------------- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-index-gateway-grpc service is running in openstack namespace --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-internal service is running in openstack namespace --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-distributor-http service is running in openstack namespace --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-compactor-http service is running in openstack namespace --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-query-frontend-grpc service is running in openstack namespace --- 0.03s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-querier-http service is running in openstack namespace --- 0.02s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-public service is running in openstack namespace --- 0.02s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-index-gateway-http service is running in openstack namespace --- 0.02s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-distributor-grpc service is running in openstack namespace --- 0.02s 2026-03-19 17:53:41,205 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-query-frontend-http service is running in openstack namespace --- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-ingester-grpc service is running in openstack namespace --- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | telemetry_chargeback : Set variables dynamically "test_dyn_basic" ------- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | telemetry_chargeback : Verify Flush Status ------------------------------ 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | telemetry_chargeback : Expected Count test_dyn_basic -------------------- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | telemetry_chargeback : Set Derived Loki URLs ---------------------------- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | telemetry_chargeback : Debug URLs --------------------------------------- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | telemetry_chargeback : Set Loki URLs ------------------------------------ 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-19 17:53:41,206 p=37082 u=zuul n=ansible | telemetry_chargeback : Cloudkitty debug OFF ----------------------------- 0.02s