2026-03-20 14:06:45,988 p=37145 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace 2026-03-20 14:06:45,988 p=37145 u=zuul n=ansible | PLAY [Verify all the applicable projects, endpoints, pods & services for cloudkitty] *** 2026-03-20 14:06:46,001 p=37145 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-20 14:06:46,002 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:46 +0000 (0:00:00.029) 0:00:00.029 ********** 2026-03-20 14:06:47,025 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:47,044 p=37145 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-20 14:06:47,045 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:47 +0000 (0:00:01.043) 0:00:01.072 ********** 2026-03-20 14:06:47,126 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-api) 2026-03-20 14:06:47,129 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-compactor) 2026-03-20 14:06:47,132 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-distributor) 2026-03-20 14:06:47,135 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway) 2026-03-20 14:06:47,138 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-ingester) 2026-03-20 14:06:47,141 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-querier) 2026-03-20 14:06:47,144 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend) 2026-03-20 14:06:47,147 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-proc) 2026-03-20 14:06:47,159 p=37145 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 14:06:47,159 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:47 +0000 (0:00:00.114) 0:00:01.187 ********** 2026-03-20 14:06:47,684 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:47,692 p=37145 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-api pod is Running in openstack namespace] *** 2026-03-20 14:06:47,692 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:47 +0000 (0:00:00.532) 0:00:01.720 ********** 2026-03-20 14:06:48,039 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:48,048 p=37145 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 14:06:48,048 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:48 +0000 (0:00:00.355) 0:00:02.076 ********** 2026-03-20 14:06:48,487 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:48,496 p=37145 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-compactor pod is Running in openstack namespace] *** 2026-03-20 14:06:48,497 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:48 +0000 (0:00:00.448) 0:00:02.524 ********** 2026-03-20 14:06:48,847 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:48,857 p=37145 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 14:06:48,857 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:48 +0000 (0:00:00.360) 0:00:02.885 ********** 2026-03-20 14:06:49,365 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:49,372 p=37145 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-distributor pod is Running in openstack namespace] *** 2026-03-20 14:06:49,373 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:49 +0000 (0:00:00.515) 0:00:03.400 ********** 2026-03-20 14:06:49,679 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:49,688 p=37145 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 14:06:49,688 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:49 +0000 (0:00:00.315) 0:00:03.716 ********** 2026-03-20 14:06:50,055 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:50,064 p=37145 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-index-gateway pod is Running in openstack namespace] *** 2026-03-20 14:06:50,064 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:50 +0000 (0:00:00.375) 0:00:04.091 ********** 2026-03-20 14:06:50,383 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:50,395 p=37145 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 14:06:50,395 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:50 +0000 (0:00:00.331) 0:00:04.422 ********** 2026-03-20 14:06:50,778 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:50,786 p=37145 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-ingester pod is Running in openstack namespace] *** 2026-03-20 14:06:50,786 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:50 +0000 (0:00:00.391) 0:00:04.814 ********** 2026-03-20 14:06:52,169 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:52,178 p=37145 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 14:06:52,178 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:52 +0000 (0:00:01.392) 0:00:06.206 ********** 2026-03-20 14:06:52,551 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:52,559 p=37145 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-querier pod is Running in openstack namespace] *** 2026-03-20 14:06:52,559 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:52 +0000 (0:00:00.380) 0:00:06.587 ********** 2026-03-20 14:06:52,881 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:52,889 p=37145 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 14:06:52,889 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:52 +0000 (0:00:00.329) 0:00:06.917 ********** 2026-03-20 14:06:53,256 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:53,266 p=37145 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-query-frontend pod is Running in openstack namespace] *** 2026-03-20 14:06:53,266 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:53 +0000 (0:00:00.376) 0:00:07.293 ********** 2026-03-20 14:06:53,601 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:53,611 p=37145 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 14:06:53,611 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:53 +0000 (0:00:00.345) 0:00:07.639 ********** 2026-03-20 14:06:54,003 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:54,012 p=37145 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-proc pod is Running in openstack namespace] *** 2026-03-20 14:06:54,013 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:54 +0000 (0:00:00.401) 0:00:08.040 ********** 2026-03-20 14:06:54,326 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:54,333 p=37145 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-20 14:06:54,333 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:54 +0000 (0:00:00.320) 0:00:08.361 ********** 2026-03-20 14:06:54,347 p=37145 u=zuul n=ansible | skipping: [localhost] 2026-03-20 14:06:54,354 p=37145 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-20 14:06:54,354 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:54 +0000 (0:00:00.020) 0:00:08.381 ********** 2026-03-20 14:06:54,379 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for localhost => (item=['cloudkitty', 'rating', 'public']) 2026-03-20 14:06:54,381 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for localhost => (item=['cloudkitty', 'rating', 'internal']) 2026-03-20 14:06:54,400 p=37145 u=zuul n=ansible | TASK [common : Verify endpoint "['cloudkitty', 'rating', 'public']"] *********** 2026-03-20 14:06:54,400 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:54 +0000 (0:00:00.046) 0:00:08.427 ********** 2026-03-20 14:06:56,726 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:56,737 p=37145 u=zuul n=ansible | TASK [common : TEST Check that cloudkitty public endpoint exists] ************** 2026-03-20 14:06:56,737 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:56 +0000 (0:00:02.336) 0:00:10.764 ********** 2026-03-20 14:06:56,755 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "The endpoint cloudkitty is found." } 2026-03-20 14:06:56,762 p=37145 u=zuul n=ansible | TASK [common : Verify endpoint "['cloudkitty', 'rating', 'internal']"] ********* 2026-03-20 14:06:56,762 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:56 +0000 (0:00:00.025) 0:00:10.790 ********** 2026-03-20 14:06:59,217 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:59,225 p=37145 u=zuul n=ansible | TASK [common : TEST Check that cloudkitty internal endpoint exists] ************ 2026-03-20 14:06:59,225 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:59 +0000 (0:00:02.462) 0:00:13.253 ********** 2026-03-20 14:06:59,251 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "The endpoint cloudkitty is found." } 2026-03-20 14:06:59,261 p=37145 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-20 14:06:59,261 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:59 +0000 (0:00:00.035) 0:00:13.288 ********** 2026-03-20 14:06:59,299 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for localhost => (item=openstack) 2026-03-20 14:06:59,303 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for localhost => (item=openstack-operators) 2026-03-20 14:06:59,343 p=37145 u=zuul n=ansible | TASK [common : Get the openstack project] ************************************** 2026-03-20 14:06:59,343 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:59 +0000 (0:00:00.082) 0:00:13.371 ********** 2026-03-20 14:06:59,730 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:06:59,738 p=37145 u=zuul n=ansible | TASK [common : TEST Verify openstack project exists] *************************** 2026-03-20 14:06:59,738 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:59 +0000 (0:00:00.394) 0:00:13.765 ********** 2026-03-20 14:06:59,756 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "project openstack is found." } 2026-03-20 14:06:59,765 p=37145 u=zuul n=ansible | TASK [common : Get the openstack-operators project] **************************** 2026-03-20 14:06:59,766 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:06:59 +0000 (0:00:00.027) 0:00:13.793 ********** 2026-03-20 14:07:00,099 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:00,107 p=37145 u=zuul n=ansible | TASK [common : TEST Verify openstack-operators project exists] ***************** 2026-03-20 14:07:00,107 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:00 +0000 (0:00:00.341) 0:00:14.135 ********** 2026-03-20 14:07:00,124 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "project openstack-operators is found." } 2026-03-20 14:07:00,131 p=37145 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-20 14:07:00,131 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:00 +0000 (0:00:00.023) 0:00:14.158 ********** 2026-03-20 14:07:00,234 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-internal) 2026-03-20 14:07:00,236 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-compactor-grpc) 2026-03-20 14:07:00,238 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-compactor-http) 2026-03-20 14:07:00,240 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-distributor-grpc) 2026-03-20 14:07:00,243 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-distributor-http) 2026-03-20 14:07:00,245 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-gateway-http) 2026-03-20 14:07:00,247 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-gossip-ring) 2026-03-20 14:07:00,249 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway-grpc) 2026-03-20 14:07:00,251 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway-http) 2026-03-20 14:07:00,253 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-ingester-grpc) 2026-03-20 14:07:00,256 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-ingester-http) 2026-03-20 14:07:00,258 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-querier-grpc) 2026-03-20 14:07:00,261 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-querier-http) 2026-03-20 14:07:00,263 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend-grpc) 2026-03-20 14:07:00,265 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend-http) 2026-03-20 14:07:00,267 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-public) 2026-03-20 14:07:00,293 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-internal"] ************************* 2026-03-20 14:07:00,293 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:00 +0000 (0:00:00.162) 0:00:14.320 ********** 2026-03-20 14:07:00,619 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:00,627 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-internal service is running in openstack namespace] *** 2026-03-20 14:07:00,628 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:00 +0000 (0:00:00.334) 0:00:14.655 ********** 2026-03-20 14:07:00,645 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-internal is running." } 2026-03-20 14:07:00,653 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-compactor-grpc"] ********* 2026-03-20 14:07:00,653 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:00 +0000 (0:00:00.025) 0:00:14.680 ********** 2026-03-20 14:07:00,996 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:01,006 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-compactor-grpc service is running in openstack namespace] *** 2026-03-20 14:07:01,006 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:01 +0000 (0:00:00.352) 0:00:15.033 ********** 2026-03-20 14:07:01,027 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-compactor-grpc is running." } 2026-03-20 14:07:01,035 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-compactor-http"] ********* 2026-03-20 14:07:01,035 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:01 +0000 (0:00:00.029) 0:00:15.063 ********** 2026-03-20 14:07:01,408 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:01,416 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-compactor-http service is running in openstack namespace] *** 2026-03-20 14:07:01,416 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:01 +0000 (0:00:00.381) 0:00:15.444 ********** 2026-03-20 14:07:01,435 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-compactor-http is running." } 2026-03-20 14:07:01,442 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-distributor-grpc"] ******* 2026-03-20 14:07:01,442 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:01 +0000 (0:00:00.025) 0:00:15.470 ********** 2026-03-20 14:07:01,788 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:01,796 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-distributor-grpc service is running in openstack namespace] *** 2026-03-20 14:07:01,796 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:01 +0000 (0:00:00.353) 0:00:15.823 ********** 2026-03-20 14:07:01,813 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-distributor-grpc is running." } 2026-03-20 14:07:01,821 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-distributor-http"] ******* 2026-03-20 14:07:01,821 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:01 +0000 (0:00:00.024) 0:00:15.848 ********** 2026-03-20 14:07:02,151 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:02,159 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-distributor-http service is running in openstack namespace] *** 2026-03-20 14:07:02,159 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:02 +0000 (0:00:00.338) 0:00:16.187 ********** 2026-03-20 14:07:02,177 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-distributor-http is running." } 2026-03-20 14:07:02,185 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-gateway-http"] *********** 2026-03-20 14:07:02,186 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:02 +0000 (0:00:00.026) 0:00:16.213 ********** 2026-03-20 14:07:02,514 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:02,521 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-gateway-http service is running in openstack namespace] *** 2026-03-20 14:07:02,521 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:02 +0000 (0:00:00.335) 0:00:16.549 ********** 2026-03-20 14:07:02,539 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-gateway-http is running." } 2026-03-20 14:07:02,547 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-gossip-ring"] ************ 2026-03-20 14:07:02,547 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:02 +0000 (0:00:00.025) 0:00:16.574 ********** 2026-03-20 14:07:02,856 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:02,863 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-gossip-ring service is running in openstack namespace] *** 2026-03-20 14:07:02,863 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:02 +0000 (0:00:00.316) 0:00:16.891 ********** 2026-03-20 14:07:02,879 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-gossip-ring is running." } 2026-03-20 14:07:02,886 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-index-gateway-grpc"] ***** 2026-03-20 14:07:02,887 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:02 +0000 (0:00:00.023) 0:00:16.914 ********** 2026-03-20 14:07:03,200 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:03,210 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-index-gateway-grpc service is running in openstack namespace] *** 2026-03-20 14:07:03,210 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:03 +0000 (0:00:00.323) 0:00:17.237 ********** 2026-03-20 14:07:03,229 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-index-gateway-grpc is running." } 2026-03-20 14:07:03,236 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-index-gateway-http"] ***** 2026-03-20 14:07:03,237 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:03 +0000 (0:00:00.026) 0:00:17.264 ********** 2026-03-20 14:07:03,581 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:03,589 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-index-gateway-http service is running in openstack namespace] *** 2026-03-20 14:07:03,589 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:03 +0000 (0:00:00.352) 0:00:17.616 ********** 2026-03-20 14:07:03,606 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-index-gateway-http is running." } 2026-03-20 14:07:03,613 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-ingester-grpc"] ********** 2026-03-20 14:07:03,613 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:03 +0000 (0:00:00.024) 0:00:17.641 ********** 2026-03-20 14:07:03,935 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:03,943 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-ingester-grpc service is running in openstack namespace] *** 2026-03-20 14:07:03,943 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:03 +0000 (0:00:00.329) 0:00:17.971 ********** 2026-03-20 14:07:03,959 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-ingester-grpc is running." } 2026-03-20 14:07:03,967 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-ingester-http"] ********** 2026-03-20 14:07:03,967 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:03 +0000 (0:00:00.023) 0:00:17.994 ********** 2026-03-20 14:07:04,271 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:04,280 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-ingester-http service is running in openstack namespace] *** 2026-03-20 14:07:04,280 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:04 +0000 (0:00:00.313) 0:00:18.308 ********** 2026-03-20 14:07:04,296 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-ingester-http is running." } 2026-03-20 14:07:04,305 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-querier-grpc"] *********** 2026-03-20 14:07:04,305 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:04 +0000 (0:00:00.024) 0:00:18.332 ********** 2026-03-20 14:07:04,662 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:04,670 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-querier-grpc service is running in openstack namespace] *** 2026-03-20 14:07:04,671 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:04 +0000 (0:00:00.365) 0:00:18.698 ********** 2026-03-20 14:07:04,687 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-querier-grpc is running." } 2026-03-20 14:07:04,696 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-querier-http"] *********** 2026-03-20 14:07:04,696 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:04 +0000 (0:00:00.025) 0:00:18.723 ********** 2026-03-20 14:07:05,034 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:05,042 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-querier-http service is running in openstack namespace] *** 2026-03-20 14:07:05,042 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:05 +0000 (0:00:00.346) 0:00:19.069 ********** 2026-03-20 14:07:05,059 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-querier-http is running." } 2026-03-20 14:07:05,067 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-query-frontend-grpc"] **** 2026-03-20 14:07:05,067 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:05 +0000 (0:00:00.025) 0:00:19.095 ********** 2026-03-20 14:07:05,399 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:05,406 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-query-frontend-grpc service is running in openstack namespace] *** 2026-03-20 14:07:05,406 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:05 +0000 (0:00:00.339) 0:00:19.434 ********** 2026-03-20 14:07:05,424 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-query-frontend-grpc is running." } 2026-03-20 14:07:05,431 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-query-frontend-http"] **** 2026-03-20 14:07:05,431 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:05 +0000 (0:00:00.024) 0:00:19.458 ********** 2026-03-20 14:07:05,764 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:05,772 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-query-frontend-http service is running in openstack namespace] *** 2026-03-20 14:07:05,772 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:05 +0000 (0:00:00.341) 0:00:19.799 ********** 2026-03-20 14:07:05,791 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-query-frontend-http is running." } 2026-03-20 14:07:05,799 p=37145 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-public"] *************************** 2026-03-20 14:07:05,800 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:05 +0000 (0:00:00.027) 0:00:19.827 ********** 2026-03-20 14:07:06,135 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:06,143 p=37145 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-public service is running in openstack namespace] *** 2026-03-20 14:07:06,143 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:06 +0000 (0:00:00.343) 0:00:20.171 ********** 2026-03-20 14:07:06,160 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-public is running." } 2026-03-20 14:07:06,166 p=37145 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-20 14:07:06,166 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:06 +0000 (0:00:00.022) 0:00:20.194 ********** 2026-03-20 14:07:06,181 p=37145 u=zuul n=ansible | skipping: [localhost] 2026-03-20 14:07:06,188 p=37145 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-20 14:07:06,188 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:06 +0000 (0:00:00.021) 0:00:20.216 ********** 2026-03-20 14:07:06,203 p=37145 u=zuul n=ansible | skipping: [localhost] 2026-03-20 14:07:06,210 p=37145 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-20 14:07:06,210 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:06 +0000 (0:00:00.022) 0:00:20.238 ********** 2026-03-20 14:07:06,228 p=37145 u=zuul n=ansible | skipping: [localhost] 2026-03-20 14:07:06,235 p=37145 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-20 14:07:06,235 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:06 +0000 (0:00:00.024) 0:00:20.263 ********** 2026-03-20 14:07:06,253 p=37145 u=zuul n=ansible | skipping: [localhost] 2026-03-20 14:07:06,263 p=37145 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-20 14:07:06,264 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:06 +0000 (0:00:00.028) 0:00:20.291 ********** 2026-03-20 14:07:06,281 p=37145 u=zuul n=ansible | skipping: [localhost] 2026-03-20 14:07:06,291 p=37145 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-20 14:07:06,292 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:06 +0000 (0:00:00.027) 0:00:20.319 ********** 2026-03-20 14:07:06,310 p=37145 u=zuul n=ansible | skipping: [localhost] 2026-03-20 14:07:06,325 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Validate Chargeback Feature deployed correctly] *** 2026-03-20 14:07:06,325 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:06 +0000 (0:00:00.033) 0:00:20.352 ********** 2026-03-20 14:07:06,343 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/chargeback_tests.yml for localhost 2026-03-20 14:07:06,352 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Enable Cloudkitty Module (hashmap)] *************** 2026-03-20 14:07:06,352 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:06 +0000 (0:00:00.027) 0:00:20.380 ********** 2026-03-20 14:07:10,117 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:07:10,127 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Find the current value of hashmap] **************** 2026-03-20 14:07:10,127 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:10 +0000 (0:00:03.774) 0:00:24.154 ********** 2026-03-20 14:07:13,010 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:13,018 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Change priority for CloudKitty hashmap module] **** 2026-03-20 14:07:13,018 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:13 +0000 (0:00:02.891) 0:00:27.046 ********** 2026-03-20 14:07:16,354 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:07:16,362 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Get status of all CloudKitty rating modules] ****** 2026-03-20 14:07:16,363 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:16 +0000 (0:00:03.343) 0:00:30.390 ********** 2026-03-20 14:07:19,017 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:19,025 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Validate CloudKitty module states] *********** 2026-03-20 14:07:19,025 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:19 +0000 (0:00:02.662) 0:00:33.052 ********** 2026-03-20 14:07:19,067 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "SUCCESS: CloudKitty modules (hashmap=True) are configured correctly." } 2026-03-20 14:07:19,073 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Set priority for CloudKitty hashmap module] *** 2026-03-20 14:07:19,073 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:19 +0000 (0:00:00.048) 0:00:33.101 ********** 2026-03-20 14:07:19,098 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "SUCCESS: The hashmap priority is set to 100" } 2026-03-20 14:07:19,108 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Setup Loki Environment] *************************** 2026-03-20 14:07:19,108 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:19 +0000 (0:00:00.034) 0:00:33.135 ********** 2026-03-20 14:07:19,131 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/setup_loki_env.yml for localhost 2026-03-20 14:07:19,149 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Get Loki Public Route Host] *********************** 2026-03-20 14:07:19,149 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:19 +0000 (0:00:00.041) 0:00:33.177 ********** 2026-03-20 14:07:19,511 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:19,518 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Set Loki URLs] ************************************ 2026-03-20 14:07:19,518 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:19 +0000 (0:00:00.368) 0:00:33.545 ********** 2026-03-20 14:07:19,533 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:19,541 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Set Derived Loki URLs] **************************** 2026-03-20 14:07:19,541 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:19 +0000 (0:00:00.023) 0:00:33.569 ********** 2026-03-20 14:07:19,556 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:19,564 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Debug URLs] *************************************** 2026-03-20 14:07:19,564 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:19 +0000 (0:00:00.023) 0:00:33.592 ********** 2026-03-20 14:07:19,584 p=37145 u=zuul n=ansible | ok: [localhost] => { "msg": [ "Loki Route: https://cloudkitty-lokistack-openstack.apps-crc.testing", "Push URL: https://cloudkitty-lokistack-openstack.apps-crc.testing/api/logs/v1/cloudkitty/loki/api/v1/push", "Flush URL: https://cloudkitty-lokistack-ingester-http.openstack.svc:3100/flush", "Query URL: https://cloudkitty-lokistack-openstack.apps-crc.testing/api/logs/v1/cloudkitty/loki/api/v1/query_range" ] } 2026-03-20 14:07:19,590 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Ensure Local Certificate Directory Exists] ******** 2026-03-20 14:07:19,590 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:19 +0000 (0:00:00.026) 0:00:33.618 ********** 2026-03-20 14:07:19,889 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:07:19,896 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Extract Certificates from Openshift Secret] ******* 2026-03-20 14:07:19,896 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:19 +0000 (0:00:00.305) 0:00:33.923 ********** 2026-03-20 14:07:20,256 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:07:20,262 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Extract Client Certificates] ********************** 2026-03-20 14:07:20,262 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:20 +0000 (0:00:00.366) 0:00:34.290 ********** 2026-03-20 14:07:20,638 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:07:20,644 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Extract CA Bundle] ******************************** 2026-03-20 14:07:20,644 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:20 +0000 (0:00:00.382) 0:00:34.672 ********** 2026-03-20 14:07:20,861 p=37145 u=zuul n=ansible | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: ValueError: No closing quotation 2026-03-20 14:07:20,861 p=37145 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": true, "module_stderr": "Traceback (most recent call last):\n File \"/home/zuul/.ansible/tmp/ansible-tmp-1774015640.6650233-38283-29206957168126/AnsiballZ_command.py\", line 107, in \n _ansiballz_main()\n File \"/home/zuul/.ansible/tmp/ansible-tmp-1774015640.6650233-38283-29206957168126/AnsiballZ_command.py\", line 99, in _ansiballz_main\n invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS)\n File \"/home/zuul/.ansible/tmp/ansible-tmp-1774015640.6650233-38283-29206957168126/AnsiballZ_command.py\", line 47, in invoke_module\n runpy.run_module(mod_name='ansible.modules.command', init_globals=dict(_module_fqn='ansible.modules.command', _modlib_path=modlib_path),\n File \"/usr/lib64/python3.9/runpy.py\", line 225, in run_module\n return _run_module_code(code, init_globals, run_name, mod_spec)\n File \"/usr/lib64/python3.9/runpy.py\", line 97, in _run_module_code\n _run_code(code, mod_globals, init_globals,\n File \"/usr/lib64/python3.9/runpy.py\", line 87, in _run_code\n exec(code, run_globals)\n File \"/tmp/ansible_ansible.legacy.command_payload_zdfgvu2y/ansible_ansible.legacy.command_payload.zip/ansible/modules/command.py\", line 354, in \n File \"/tmp/ansible_ansible.legacy.command_payload_zdfgvu2y/ansible_ansible.legacy.command_payload.zip/ansible/modules/command.py\", line 276, in main\n File \"/usr/lib64/python3.9/shlex.py\", line 315, in split\n return list(lex)\n File \"/usr/lib64/python3.9/shlex.py\", line 300, in __next__\n token = self.get_token()\n File \"/usr/lib64/python3.9/shlex.py\", line 109, in get_token\n raw = self.read_token()\n File \"/usr/lib64/python3.9/shlex.py\", line 191, in read_token\n raise ValueError(\"No closing quotation\")\nValueError: No closing quotation\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1} 2026-03-20 14:07:20,861 p=37145 u=zuul n=ansible | ...ignoring 2026-03-20 14:07:20,868 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Cloudkitty debug ON] ****************************** 2026-03-20 14:07:20,868 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:20 +0000 (0:00:00.224) 0:00:34.896 ********** 2026-03-20 14:07:20,881 p=37145 u=zuul n=ansible | skipping: [localhost] 2026-03-20 14:07:20,887 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Cloudkitty debug OFF] ***************************** 2026-03-20 14:07:20,888 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:20 +0000 (0:00:00.019) 0:00:34.915 ********** 2026-03-20 14:07:20,904 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:20,910 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Get admin project ID for CI] ********************** 2026-03-20 14:07:20,910 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:20 +0000 (0:00:00.022) 0:00:34.938 ********** 2026-03-20 14:07:23,305 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:23,312 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Set admin project ID for CI] ********************** 2026-03-20 14:07:23,313 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:23 +0000 (0:00:02.402) 0:00:37.340 ********** 2026-03-20 14:07:23,334 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:23,341 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Get admin user ID for CI] ************************* 2026-03-20 14:07:23,341 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:23 +0000 (0:00:00.028) 0:00:37.368 ********** 2026-03-20 14:07:25,588 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:25,596 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Set admin user ID for CI] ************************* 2026-03-20 14:07:25,597 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:25 +0000 (0:00:02.255) 0:00:39.624 ********** 2026-03-20 14:07:25,620 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:25,628 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Find test files] ********************************** 2026-03-20 14:07:25,629 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:25 +0000 (0:00:00.032) 0:00:39.656 ********** 2026-03-20 14:07:25,980 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:25,992 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Extract only the filenames into a clean list] ***** 2026-03-20 14:07:25,992 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:25 +0000 (0:00:00.363) 0:00:40.020 ********** 2026-03-20 14:07:26,013 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:26,022 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Process and Loop if files exist] ****************** 2026-03-20 14:07:26,023 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:26 +0000 (0:00:00.030) 0:00:40.050 ********** 2026-03-20 14:07:26,059 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/run_test_scenarios.yml for localhost => (item=test_dyn_basic) 2026-03-20 14:07:26,071 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Generate Synthetic Data for each file: test_dyn_basic] *** 2026-03-20 14:07:26,071 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:26 +0000 (0:00:00.048) 0:00:40.098 ********** 2026-03-20 14:07:26,093 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/gen_synth_loki_data.yml for localhost 2026-03-20 14:07:26,106 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Set variables dynamically "test_dyn_basic"] ******* 2026-03-20 14:07:26,107 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:26 +0000 (0:00:00.035) 0:00:40.134 ********** 2026-03-20 14:07:26,124 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:26,130 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Check for preexisting output file] **************** 2026-03-20 14:07:26,130 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:26 +0000 (0:00:00.023) 0:00:40.158 ********** 2026-03-20 14:07:26,452 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:26,461 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Generate Synthetic Data "test_dyn_basic"] ********* 2026-03-20 14:07:26,461 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:26 +0000 (0:00:00.330) 0:00:40.488 ********** 2026-03-20 14:07:26,821 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:07:26,829 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Generate chargeback rating from synthetic data file "test_dyn_basic"] *** 2026-03-20 14:07:26,829 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:26 +0000 (0:00:00.368) 0:00:40.856 ********** 2026-03-20 14:07:27,060 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:07:27,067 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Load metrics from YAML file] ********************** 2026-03-20 14:07:27,067 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:27 +0000 (0:00:00.238) 0:00:41.094 ********** 2026-03-20 14:07:27,082 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:27,090 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Load data to loki: test_dyn_basic] **************** 2026-03-20 14:07:27,090 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:27 +0000 (0:00:00.023) 0:00:41.118 ********** 2026-03-20 14:07:27,110 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/load_loki_data.yml for localhost 2026-03-20 14:07:27,125 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Ingests Cloudkitty Data log "test_dyn_basic"] ***** 2026-03-20 14:07:27,125 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:27 +0000 (0:00:00.034) 0:00:41.152 ********** 2026-03-20 14:07:27,143 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/ingest_loki_data.yml for localhost 2026-03-20 14:07:27,152 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Read log file content] **************************** 2026-03-20 14:07:27,153 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:27 +0000 (0:00:00.027) 0:00:41.180 ********** 2026-03-20 14:07:27,470 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:27,477 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Push data to Loki] ******************************** 2026-03-20 14:07:27,477 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:27 +0000 (0:00:00.324) 0:00:41.505 ********** 2026-03-20 14:07:28,177 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:28,185 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Confirm Success] ********************************** 2026-03-20 14:07:28,185 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:28 +0000 (0:00:00.707) 0:00:42.212 ********** 2026-03-20 14:07:28,199 p=37145 u=zuul n=ansible | ok: [localhost] => { "msg": "Ingestion Successful!" } 2026-03-20 14:07:28,207 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Flush Data to loki Storage " test_dyn_basic"] ***** 2026-03-20 14:07:28,207 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:28 +0000 (0:00:00.022) 0:00:42.235 ********** 2026-03-20 14:07:28,227 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/flush_loki_data.yml for localhost 2026-03-20 14:07:28,239 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Create directory inside openstack CLI] ************ 2026-03-20 14:07:28,239 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:28 +0000 (0:00:00.031) 0:00:42.267 ********** 2026-03-20 14:07:28,636 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:28,646 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Create a directory to extract certificates] ******* 2026-03-20 14:07:28,646 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:28 +0000 (0:00:00.406) 0:00:42.674 ********** 2026-03-20 14:07:28,839 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:07:28,845 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Copy certificates to openstack CLI] *************** 2026-03-20 14:07:28,845 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:28 +0000 (0:00:00.199) 0:00:42.873 ********** 2026-03-20 14:07:29,331 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:07:29,338 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Trigger Flush] ************************************ 2026-03-20 14:07:29,339 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:29 +0000 (0:00:00.493) 0:00:43.366 ********** 2026-03-20 14:07:29,812 p=37145 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["oc", "exec", "-n", "openstack", "openstackclient", "--", "curl", "-v", "-X", "POST", "https://cloudkitty-lokistack-ingester-http.openstack.svc:3100/flush", "--cert", "osp-certs/tls.crt", "--key", "osp-certs/tls.key", "--cacert", "osp-certs/service-ca.crt"], "delta": "0:00:00.285058", "end": "2026-03-20 14:07:29.786709", "failed_when_result": true, "msg": "non-zero return code", "rc": 77, "start": "2026-03-20 14:07:29.501651", "stderr": " % Total % Received % Xferd Average Speed Time Time Time Current\n Dload Upload Total Spent Left Speed\n\r 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Trying 10.217.5.10:3100...\n* Connected to cloudkitty-lokistack-ingester-http.openstack.svc (10.217.5.10) port 3100 (#0)\n* ALPN, offering h2\n* ALPN, offering http/1.1\n* error setting certificate file: osp-certs/service-ca.crt\n\r 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0\n* Closing connection 0\ncurl: (77) error setting certificate file: osp-certs/service-ca.crt\ncommand terminated with exit code 77", "stderr_lines": [" % Total % Received % Xferd Average Speed Time Time Time Current", " Dload Upload Total Spent Left Speed", "", " 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Trying 10.217.5.10:3100...", "* Connected to cloudkitty-lokistack-ingester-http.openstack.svc (10.217.5.10) port 3100 (#0)", "* ALPN, offering h2", "* ALPN, offering http/1.1", "* error setting certificate file: osp-certs/service-ca.crt", "", " 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0", "* Closing connection 0", "curl: (77) error setting certificate file: osp-certs/service-ca.crt", "command terminated with exit code 77"], "stdout": "", "stdout_lines": []} 2026-03-20 14:07:29,812 p=37145 u=zuul n=ansible | ...ignoring 2026-03-20 14:07:29,822 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Verify Flush Status] ****************************** 2026-03-20 14:07:29,822 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:29 +0000 (0:00:00.483) 0:00:43.849 ********** 2026-03-20 14:07:29,841 p=37145 u=zuul n=ansible | fatal: [localhost]: FAILED! => { "assertion": "'204' in flush_response.stderr or '200' in flush_response.stderr", "changed": false, "evaluated_to": false, "msg": "Flush failed" } 2026-03-20 14:07:29,841 p=37145 u=zuul n=ansible | ...ignoring 2026-03-20 14:07:29,850 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Retrieve Data log from loki "test_dyn_basic"] ***** 2026-03-20 14:07:29,850 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:29 +0000 (0:00:00.028) 0:00:43.877 ********** 2026-03-20 14:07:29,870 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/retrieve_loki_data.yml for localhost 2026-03-20 14:07:29,894 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Expected Count test_dyn_basic] ******************** 2026-03-20 14:07:29,894 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:29 +0000 (0:00:00.043) 0:00:43.921 ********** 2026-03-20 14:07:29,911 p=37145 u=zuul n=ansible | ok: [localhost] => { "msg": "Input file has 42 data entries that Loki has to return" } 2026-03-20 14:07:29,918 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Query Loki API] *********************************** 2026-03-20 14:07:29,918 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:07:29 +0000 (0:00:00.024) 0:00:43.946 ********** 2026-03-20 14:32:41,782 p=37145 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"attempts": 25, "changed": false, "connection": "close", "content": "{\"status\":\"success\",\"data\":{\"resultType\":\"streams\",\"result\":[],\"stats\":{\"summary\":{\"bytesProcessedPerSecond\":0,\"linesProcessedPerSecond\":0,\"totalBytesProcessed\":0,\"totalLinesProcessed\":0,\"execTime\":0.081852,\"queueTime\":0,\"subqueries\":0,\"totalEntriesReturned\":0,\"splits\":50,\"shards\":50,\"totalPostFilterLines\":0,\"totalStructuredMetadataBytesProcessed\":0},\"querier\":{\"store\":{\"totalChunksRef\":0,\"totalChunksDownloaded\":0,\"chunksDownloadTime\":0,\"queryReferencedStructuredMetadata\":false,\"chunk\":{\"headChunkBytes\":0,\"headChunkLines\":0,\"decompressedBytes\":0,\"decompressedLines\":0,\"compressedBytes\":0,\"totalDuplicates\":0,\"postFilterLines\":0,\"headChunkStructuredMetadataBytes\":0,\"decompressedStructuredMetadataBytes\":0},\"chunkRefsFetchTime\":30872482,\"congestionControlLatency\":0,\"pipelineWrapperFilteredLines\":0}},\"ingester\":{\"totalReached\":7,\"totalChunksMatched\":0,\"totalBatches\":7,\"totalLinesSent\":0,\"store\":{\"totalChunksRef\":0,\"totalChunksDownloaded\":0,\"chunksDownloadTime\":0,\"queryReferencedStructuredMetadata\":false,\"chunk\":{\"headChunkBytes\":0,\"headChunkLines\":0,\"decompressedBytes\":0,\"decompressedLines\":0,\"compressedBytes\":0,\"totalDuplicates\":0,\"postFilterLines\":0,\"headChunkStructuredMetadataBytes\":0,\"decompressedStructuredMetadataBytes\":0},\"chunkRefsFetchTime\":0,\"congestionControlLatency\":0,\"pipelineWrapperFilteredLines\":0}},\"cache\":{\"chunk\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"index\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"result\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"statsResult\":{\"entriesFound\":49,\"entriesRequested\":49,\"entriesStored\":0,\"bytesReceived\":10927,\"bytesSent\":0,\"requests\":49,\"downloadTime\":245638,\"queryLengthServed\":87393000000000},\"volumeResult\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"seriesResult\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"labelResult\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0},\"instantMetricResult\":{\"entriesFound\":0,\"entriesRequested\":0,\"entriesStored\":0,\"bytesReceived\":0,\"bytesSent\":0,\"requests\":0,\"downloadTime\":0,\"queryLengthServed\":0}},\"index\":{\"totalChunks\":0,\"postFilterChunks\":0,\"shardsDuration\":0,\"usedBloomFilters\":false}}}}\n", "content_type": "application/json; charset=UTF-8", "cookies": {}, "cookies_string": "", "date": "Fri, 20 Mar 2026 14:32:41 GMT", "elapsed": 0, "json": {"data": {"result": [], "resultType": "streams", "stats": {"cache": {"chunk": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "index": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "instantMetricResult": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "labelResult": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "result": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "seriesResult": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}, "statsResult": {"bytesReceived": 10927, "bytesSent": 0, "downloadTime": 245638, "entriesFound": 49, "entriesRequested": 49, "entriesStored": 0, "queryLengthServed": 87393000000000, "requests": 49}, "volumeResult": {"bytesReceived": 0, "bytesSent": 0, "downloadTime": 0, "entriesFound": 0, "entriesRequested": 0, "entriesStored": 0, "queryLengthServed": 0, "requests": 0}}, "index": {"postFilterChunks": 0, "shardsDuration": 0, "totalChunks": 0, "usedBloomFilters": false}, "ingester": {"store": {"chunk": {"compressedBytes": 0, "decompressedBytes": 0, "decompressedLines": 0, "decompressedStructuredMetadataBytes": 0, "headChunkBytes": 0, "headChunkLines": 0, "headChunkStructuredMetadataBytes": 0, "postFilterLines": 0, "totalDuplicates": 0}, "chunkRefsFetchTime": 0, "chunksDownloadTime": 0, "congestionControlLatency": 0, "pipelineWrapperFilteredLines": 0, "queryReferencedStructuredMetadata": false, "totalChunksDownloaded": 0, "totalChunksRef": 0}, "totalBatches": 7, "totalChunksMatched": 0, "totalLinesSent": 0, "totalReached": 7}, "querier": {"store": {"chunk": {"compressedBytes": 0, "decompressedBytes": 0, "decompressedLines": 0, "decompressedStructuredMetadataBytes": 0, "headChunkBytes": 0, "headChunkLines": 0, "headChunkStructuredMetadataBytes": 0, "postFilterLines": 0, "totalDuplicates": 0}, "chunkRefsFetchTime": 30872482, "chunksDownloadTime": 0, "congestionControlLatency": 0, "pipelineWrapperFilteredLines": 0, "queryReferencedStructuredMetadata": false, "totalChunksDownloaded": 0, "totalChunksRef": 0}}, "summary": {"bytesProcessedPerSecond": 0, "execTime": 0.081852, "linesProcessedPerSecond": 0, "queueTime": 0, "shards": 50, "splits": 50, "subqueries": 0, "totalBytesProcessed": 0, "totalEntriesReturned": 0, "totalLinesProcessed": 0, "totalPostFilterLines": 0, "totalStructuredMetadataBytesProcessed": 0}}}, "status": "success"}, "msg": "OK (unknown bytes)", "redirected": false, "status": 200, "transfer_encoding": "chunked", "url": "https://cloudkitty-lokistack-openstack.apps-crc.testing/api/logs/v1/cloudkitty/loki/api/v1/query_range?query=%7Bservice%3D%22cloudkitty%22%7D&start=1773929246000000000&limit=50", "vary": "Accept-Encoding"} 2026-03-20 14:32:41,782 p=37145 u=zuul n=ansible | ...ignoring 2026-03-20 14:32:41,790 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Save Loki Data to JSON file] ********************** 2026-03-20 14:32:41,790 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:41 +0000 (0:25:11.871) 0:25:55.817 ********** 2026-03-20 14:32:42,274 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:32:42,282 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Verify Data Integrity test_dyn_basic] ************* 2026-03-20 14:32:42,282 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:42 +0000 (0:00:00.492) 0:25:56.310 ********** 2026-03-20 14:32:42,308 p=37145 u=zuul n=ansible | fatal: [localhost]: FAILED! => { "assertion": "loki_response.json.data.result | length > 0", "changed": false, "evaluated_to": false, "msg": "Query did not return all data entries. Expected 42 log entries, but Loki only returned 0" } 2026-03-20 14:32:42,308 p=37145 u=zuul n=ansible | ...ignoring 2026-03-20 14:32:42,316 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Generate chargeback stats from Loki-retrieved data file: test_dyn_basic] *** 2026-03-20 14:32:42,316 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:42 +0000 (0:00:00.033) 0:25:56.343 ********** 2026-03-20 14:32:42,541 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:32:42,549 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Get total rate from loki: test_dyn_basic] ********* 2026-03-20 14:32:42,549 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:42 +0000 (0:00:00.233) 0:25:56.576 ********** 2026-03-20 14:32:42,566 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/loki_rate.yml for localhost 2026-03-20 14:32:42,582 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Get Rate and Qty by type from Cloudkitty test_dyn_basic] *** 2026-03-20 14:32:42,582 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:42 +0000 (0:00:00.033) 0:25:56.610 ********** 2026-03-20 14:32:49,091 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:32:49,102 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : **INFO** Print the rating by type test_dyn_basic] *** 2026-03-20 14:32:49,102 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:49 +0000 (0:00:06.519) 0:26:03.129 ********** 2026-03-20 14:32:49,119 p=37145 u=zuul n=ansible | ok: [localhost] => { "cost_totals_by_type.stdout": "" } 2026-03-20 14:32:49,128 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Save output as a loadable variable file test_dyn_basic] *** 2026-03-20 14:32:49,128 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:49 +0000 (0:00:00.026) 0:26:03.156 ********** 2026-03-20 14:32:49,480 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:32:49,488 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Get Rate and Qty Summary from Cloudkitty test_dyn_basic] *** 2026-03-20 14:32:49,488 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:49 +0000 (0:00:00.360) 0:26:03.516 ********** 2026-03-20 14:32:54,834 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:32:54,850 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : **INFO** Print the rating summary test_dyn_basic] *** 2026-03-20 14:32:54,851 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:54 +0000 (0:00:05.362) 0:26:08.878 ********** 2026-03-20 14:32:54,873 p=37145 u=zuul n=ansible | ok: [localhost] => { "cost_totals_summary.stdout": "+---------------------------+---------------------------+-----+------+\n| Begin | End | Qty | Rate |\n+---------------------------+---------------------------+-----+------+\n| 2026-03-01T00:00:00+00:00 | 2026-04-01T00:00:00+00:00 | 0.0 | 0.0 |\n+---------------------------+---------------------------+-----+------+" } 2026-03-20 14:32:54,886 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Check synthetic totals file exists] *************** 2026-03-20 14:32:54,886 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:54 +0000 (0:00:00.035) 0:26:08.913 ********** 2026-03-20 14:32:55,125 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:32:55,133 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Check loki totals file exists] ******************** 2026-03-20 14:32:55,133 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:55 +0000 (0:00:00.247) 0:26:09.160 ********** 2026-03-20 14:32:55,364 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:32:55,374 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Totals files exist test_dyn_basic] *********** 2026-03-20 14:32:55,374 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:55 +0000 (0:00:00.241) 0:26:09.402 ********** 2026-03-20 14:32:55,398 p=37145 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "PASSED! Required file(s) exist test_dyn_basic: \n- /home/zuul/ci-framework-data/artifacts/test_dyn_basic-synth_metrics_summary.yml\n- /home/zuul/ci-framework-data/artifacts/test_dyn_basic-loki_metrics_summary.yml \n" } 2026-03-20 14:32:55,408 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Read the synthetic totals file] ******************* 2026-03-20 14:32:55,408 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:55 +0000 (0:00:00.033) 0:26:09.435 ********** 2026-03-20 14:32:55,604 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:32:55,611 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Read loki totals yaml file] *********************** 2026-03-20 14:32:55,611 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:55 +0000 (0:00:00.203) 0:26:09.639 ********** 2026-03-20 14:32:55,796 p=37145 u=zuul n=ansible | ok: [localhost] 2026-03-20 14:32:55,804 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Compare synthetic data vs loki data results test_dyn_basic] *** 2026-03-20 14:32:55,804 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:55 +0000 (0:00:00.192) 0:26:09.831 ********** 2026-03-20 14:32:55,823 p=37145 u=zuul n=ansible | fatal: [localhost]: FAILED! => { "assertion": "(synth_data.content | b64decode | from_yaml).data_log == (loki_data.content | b64decode | from_yaml).data_log", "changed": false, "evaluated_to": false, "msg": "FAILED! test_dyn_basic" } 2026-03-20 14:32:55,823 p=37145 u=zuul n=ansible | ...ignoring 2026-03-20 14:32:55,829 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Cleanup after job run] **************************** 2026-03-20 14:32:55,829 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:55 +0000 (0:00:00.025) 0:26:09.857 ********** 2026-03-20 14:32:55,845 p=37145 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/cleanup_ck.yml for localhost 2026-03-20 14:32:55,856 p=37145 u=zuul n=ansible | TASK [telemetry_chargeback : Cleanup local certificates] *********************** 2026-03-20 14:32:55,856 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:55 +0000 (0:00:00.026) 0:26:09.883 ********** 2026-03-20 14:32:56,053 p=37145 u=zuul n=ansible | changed: [localhost] 2026-03-20 14:32:56,078 p=37145 u=zuul n=ansible | PLAY RECAP ********************************************************************* 2026-03-20 14:32:56,079 p=37145 u=zuul n=ansible | localhost : ok=146 changed=16 unreachable=0 failed=0 skipped=8 rescued=0 ignored=6 2026-03-20 14:32:56,085 p=37145 u=zuul n=ansible | Friday 20 March 2026 14:32:56 +0000 (0:00:00.229) 0:26:10.113 ********** 2026-03-20 14:32:56,085 p=37145 u=zuul n=ansible | =============================================================================== 2026-03-20 14:32:56,085 p=37145 u=zuul n=ansible | telemetry_chargeback : Query Loki API -------------------------------- 1511.87s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : TEST Get Rate and Qty by type from Cloudkitty test_dyn_basic --- 6.52s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : TEST Get Rate and Qty Summary from Cloudkitty test_dyn_basic --- 5.36s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Enable Cloudkitty Module (hashmap) --------------- 3.77s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Change priority for CloudKitty hashmap module ---- 3.34s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Find the current value of hashmap ---------------- 2.89s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Get status of all CloudKitty rating modules ------ 2.66s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Verify endpoint "['cloudkitty', 'rating', 'internal']" --------- 2.46s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Get admin project ID for CI ---------------------- 2.40s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Verify endpoint "['cloudkitty', 'rating', 'public']" ----------- 2.34s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Get admin user ID for CI ------------------------- 2.26s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-ingester pod is Running in openstack namespace --- 1.39s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 1.04s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Push data to Loki -------------------------------- 0.71s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.53s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.52s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Copy certificates to openstack CLI --------------- 0.49s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Save Loki Data to JSON file ---------------------- 0.49s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Trigger Flush ------------------------------------ 0.48s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.45s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Create directory inside openstack CLI ------------ 0.41s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.40s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Get the openstack project -------------------------------------- 0.39s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.39s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Extract Client Certificates ---------------------- 0.38s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-compactor-http" --------- 0.38s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.38s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.38s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.38s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Get Loki Public Route Host ----------------------- 0.37s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Generate Synthetic Data "test_dyn_basic" --------- 0.37s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Extract Certificates from Openshift Secret ------- 0.37s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-querier-grpc" ----------- 0.37s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Find test files ---------------------------------- 0.36s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-compactor pod is Running in openstack namespace --- 0.36s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | telemetry_chargeback : Save output as a loadable variable file test_dyn_basic --- 0.36s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : TEST Check cloudkitty-api pod is Running in openstack namespace --- 0.36s 2026-03-20 14:32:56,086 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-distributor-grpc" ------- 0.35s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-compactor-grpc" --------- 0.35s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-index-gateway-http" ----- 0.35s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-querier-http" ----------- 0.35s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-query-frontend pod is Running in openstack namespace --- 0.35s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-public" --------------------------- 0.34s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Get the openstack-operators project ---------------------------- 0.34s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-query-frontend-http" ---- 0.34s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-query-frontend-grpc" ---- 0.34s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-distributor-http" ------- 0.34s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-gateway-http" ----------- 0.34s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-internal" ------------------------- 0.33s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-index-gateway pod is Running in openstack namespace --- 0.33s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Check for preexisting output file ---------------- 0.33s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-querier pod is Running in openstack namespace --- 0.33s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-ingester-grpc" ---------- 0.33s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Read log file content ---------------------------- 0.32s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-index-gateway-grpc" ----- 0.32s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : TEST Check cloudkitty-proc pod is Running in openstack namespace --- 0.32s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-gossip-ring" ------------ 0.32s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-distributor pod is Running in openstack namespace --- 0.32s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-ingester-http" ---------- 0.31s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Ensure Local Certificate Directory Exists -------- 0.31s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Check synthetic totals file exists --------------- 0.25s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Check loki totals file exists -------------------- 0.24s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Generate chargeback rating from synthetic data file "test_dyn_basic" --- 0.24s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Generate chargeback stats from Loki-retrieved data file: test_dyn_basic --- 0.23s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Cleanup local certificates ----------------------- 0.23s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Extract CA Bundle -------------------------------- 0.22s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Read the synthetic totals file ------------------- 0.20s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Create a directory to extract certificates ------- 0.20s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Read loki totals yaml file ----------------------- 0.19s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.16s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.11s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.08s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : TEST Validate CloudKitty module states ----------- 0.05s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | telemetry_chargeback : Process and Loop if files exist ------------------ 0.05s 2026-03-20 14:32:56,087 p=37145 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.05s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Retrieve Data log from loki "test_dyn_basic" ----- 0.04s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Setup Loki Environment --------------------------- 0.04s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : TEST Check that cloudkitty internal endpoint exists ----------- 0.04s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Generate Synthetic Data for each file: test_dyn_basic --- 0.04s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : **INFO** Print the rating summary test_dyn_basic --- 0.04s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Load data to loki: test_dyn_basic ---------------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : TEST Set priority for CloudKitty hashmap module --- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Verify Data Integrity test_dyn_basic ------------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Get total rate from loki: test_dyn_basic --------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : TEST Totals files exist test_dyn_basic ----------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Set admin user ID for CI ------------------------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Flush Data to loki Storage " test_dyn_basic" ----- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Extract only the filenames into a clean list ----- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-compactor-grpc service is running in openstack namespace --- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Set admin project ID for CI ---------------------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Verify Flush Status ------------------------------ 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Ingests Cloudkitty Data log "test_dyn_basic" ----- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : TEST Verify openstack project exists -------------------------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-query-frontend-http service is running in openstack namespace --- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Validate Chargeback Feature deployed correctly --- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-index-gateway-grpc service is running in openstack namespace --- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-distributor-http service is running in openstack namespace --- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Cleanup after job run ---------------------------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : **INFO** Print the rating by type test_dyn_basic --- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | telemetry_chargeback : Debug URLs --------------------------------------- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-compactor-http service is running in openstack namespace --- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-gateway-http service is running in openstack namespace --- 0.03s 2026-03-20 14:32:56,088 p=37145 u=zuul n=ansible | common : TEST Check that cloudkitty public endpoint exists ------------- 0.03s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | telemetry_chargeback : TEST Compare synthetic data vs loki data results test_dyn_basic --- 0.03s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-internal service is running in openstack namespace --- 0.03s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-querier-http service is running in openstack namespace --- 0.03s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-querier-grpc service is running in openstack namespace --- 0.03s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-ingester-http service is running in openstack namespace --- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-distributor-grpc service is running in openstack namespace --- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-index-gateway-http service is running in openstack namespace --- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | telemetry_chargeback : Expected Count test_dyn_basic -------------------- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-query-frontend-grpc service is running in openstack namespace --- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | telemetry_chargeback : Set variables dynamically "test_dyn_basic" ------- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-ingester-grpc service is running in openstack namespace --- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | telemetry_chargeback : Load metrics from YAML file ---------------------- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : TEST Verify openstack-operators project exists ---------------- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | telemetry_chargeback : Set Derived Loki URLs ---------------------------- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | telemetry_chargeback : Set Loki URLs ------------------------------------ 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-gossip-ring service is running in openstack namespace --- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : TEST Verify cloudkitty-public service is running in openstack namespace --- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | telemetry_chargeback : Confirm Success ---------------------------------- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | telemetry_chargeback : Cloudkitty debug OFF ----------------------------- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-20 14:32:56,089 p=37145 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s