2026-03-20 19:59:42,455 p=37253 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace 2026-03-20 19:59:42,455 p=37253 u=zuul n=ansible | PLAY [Verify all the applicable projects, endpoints, pods & services for cloudkitty] *** 2026-03-20 19:59:42,465 p=37253 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-20 19:59:42,465 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:42 +0000 (0:00:00.026) 0:00:00.026 ********** 2026-03-20 19:59:43,520 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:43,548 p=37253 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-20 19:59:43,548 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:43 +0000 (0:00:01.082) 0:00:01.108 ********** 2026-03-20 19:59:43,650 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-api) 2026-03-20 19:59:43,654 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-compactor) 2026-03-20 19:59:43,658 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-distributor) 2026-03-20 19:59:43,661 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway) 2026-03-20 19:59:43,665 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-ingester) 2026-03-20 19:59:43,670 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-querier) 2026-03-20 19:59:43,674 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend) 2026-03-20 19:59:43,678 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-proc) 2026-03-20 19:59:43,693 p=37253 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 19:59:43,693 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:43 +0000 (0:00:00.145) 0:00:01.254 ********** 2026-03-20 19:59:44,179 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:44,188 p=37253 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-api pod is Running in openstack namespace] *** 2026-03-20 19:59:44,188 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:44 +0000 (0:00:00.494) 0:00:01.749 ********** 2026-03-20 19:59:44,530 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:44,539 p=37253 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 19:59:44,539 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:44 +0000 (0:00:00.351) 0:00:02.100 ********** 2026-03-20 19:59:44,907 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:44,915 p=37253 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-compactor pod is Running in openstack namespace] *** 2026-03-20 19:59:44,915 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:44 +0000 (0:00:00.376) 0:00:02.476 ********** 2026-03-20 19:59:45,291 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:45,300 p=37253 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 19:59:45,300 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:45 +0000 (0:00:00.384) 0:00:02.861 ********** 2026-03-20 19:59:45,740 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:45,751 p=37253 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-distributor pod is Running in openstack namespace] *** 2026-03-20 19:59:45,751 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:45 +0000 (0:00:00.451) 0:00:03.312 ********** 2026-03-20 19:59:46,082 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:46,090 p=37253 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 19:59:46,091 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:46 +0000 (0:00:00.339) 0:00:03.651 ********** 2026-03-20 19:59:46,482 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:46,489 p=37253 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-index-gateway pod is Running in openstack namespace] *** 2026-03-20 19:59:46,489 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:46 +0000 (0:00:00.398) 0:00:04.050 ********** 2026-03-20 19:59:46,820 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:46,828 p=37253 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 19:59:46,828 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:46 +0000 (0:00:00.338) 0:00:04.389 ********** 2026-03-20 19:59:47,202 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:47,211 p=37253 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-ingester pod is Running in openstack namespace] *** 2026-03-20 19:59:47,211 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:47 +0000 (0:00:00.383) 0:00:04.772 ********** 2026-03-20 19:59:47,551 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:47,562 p=37253 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 19:59:47,562 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:47 +0000 (0:00:00.350) 0:00:05.123 ********** 2026-03-20 19:59:47,988 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:47,999 p=37253 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-querier pod is Running in openstack namespace] *** 2026-03-20 19:59:48,000 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:47 +0000 (0:00:00.437) 0:00:05.560 ********** 2026-03-20 19:59:48,399 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:48,409 p=37253 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 19:59:48,409 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:48 +0000 (0:00:00.409) 0:00:05.970 ********** 2026-03-20 19:59:48,852 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:48,861 p=37253 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-query-frontend pod is Running in openstack namespace] *** 2026-03-20 19:59:48,861 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:48 +0000 (0:00:00.451) 0:00:06.422 ********** 2026-03-20 19:59:49,194 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:49,202 p=37253 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-20 19:59:49,202 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:49 +0000 (0:00:00.340) 0:00:06.763 ********** 2026-03-20 19:59:49,589 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:49,597 p=37253 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-proc pod is Running in openstack namespace] *** 2026-03-20 19:59:49,597 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:49 +0000 (0:00:00.394) 0:00:07.158 ********** 2026-03-20 19:59:49,960 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:49,967 p=37253 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-20 19:59:49,967 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:49 +0000 (0:00:00.370) 0:00:07.528 ********** 2026-03-20 19:59:49,984 p=37253 u=zuul n=ansible | skipping: [localhost] 2026-03-20 19:59:49,991 p=37253 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-20 19:59:49,991 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:49 +0000 (0:00:00.023) 0:00:07.552 ********** 2026-03-20 19:59:50,021 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for localhost => (item=['cloudkitty', 'rating', 'public']) 2026-03-20 19:59:50,024 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for localhost => (item=['cloudkitty', 'rating', 'internal']) 2026-03-20 19:59:50,043 p=37253 u=zuul n=ansible | TASK [common : Verify endpoint "['cloudkitty', 'rating', 'public']"] *********** 2026-03-20 19:59:50,043 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:50 +0000 (0:00:00.052) 0:00:07.604 ********** 2026-03-20 19:59:52,280 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:52,289 p=37253 u=zuul n=ansible | TASK [common : TEST Check that cloudkitty public endpoint exists] ************** 2026-03-20 19:59:52,290 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:52 +0000 (0:00:02.246) 0:00:09.850 ********** 2026-03-20 19:59:52,319 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "The endpoint cloudkitty is found." } 2026-03-20 19:59:52,330 p=37253 u=zuul n=ansible | TASK [common : Verify endpoint "['cloudkitty', 'rating', 'internal']"] ********* 2026-03-20 19:59:52,331 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:52 +0000 (0:00:00.040) 0:00:09.891 ********** 2026-03-20 19:59:54,772 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:54,781 p=37253 u=zuul n=ansible | TASK [common : TEST Check that cloudkitty internal endpoint exists] ************ 2026-03-20 19:59:54,781 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:54 +0000 (0:00:02.450) 0:00:12.342 ********** 2026-03-20 19:59:54,807 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "The endpoint cloudkitty is found." } 2026-03-20 19:59:54,815 p=37253 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-20 19:59:54,816 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:54 +0000 (0:00:00.034) 0:00:12.376 ********** 2026-03-20 19:59:54,855 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for localhost => (item=openstack) 2026-03-20 19:59:54,857 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for localhost => (item=openstack-operators) 2026-03-20 19:59:54,883 p=37253 u=zuul n=ansible | TASK [common : Get the openstack project] ************************************** 2026-03-20 19:59:54,883 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:54 +0000 (0:00:00.067) 0:00:12.444 ********** 2026-03-20 19:59:55,261 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:55,268 p=37253 u=zuul n=ansible | TASK [common : TEST Verify openstack project exists] *************************** 2026-03-20 19:59:55,268 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:55 +0000 (0:00:00.384) 0:00:12.829 ********** 2026-03-20 19:59:55,287 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "project openstack is found." } 2026-03-20 19:59:55,294 p=37253 u=zuul n=ansible | TASK [common : Get the openstack-operators project] **************************** 2026-03-20 19:59:55,295 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:55 +0000 (0:00:00.026) 0:00:12.855 ********** 2026-03-20 19:59:55,682 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:55,692 p=37253 u=zuul n=ansible | TASK [common : TEST Verify openstack-operators project exists] ***************** 2026-03-20 19:59:55,692 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:55 +0000 (0:00:00.397) 0:00:13.253 ********** 2026-03-20 19:59:55,711 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "project openstack-operators is found." } 2026-03-20 19:59:55,718 p=37253 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-20 19:59:55,718 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:55 +0000 (0:00:00.026) 0:00:13.279 ********** 2026-03-20 19:59:55,829 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-internal) 2026-03-20 19:59:55,831 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-compactor-grpc) 2026-03-20 19:59:55,833 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-compactor-http) 2026-03-20 19:59:55,835 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-distributor-grpc) 2026-03-20 19:59:55,837 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-distributor-http) 2026-03-20 19:59:55,840 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-gateway-http) 2026-03-20 19:59:55,842 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-gossip-ring) 2026-03-20 19:59:55,844 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway-grpc) 2026-03-20 19:59:55,846 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway-http) 2026-03-20 19:59:55,848 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-ingester-grpc) 2026-03-20 19:59:55,850 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-ingester-http) 2026-03-20 19:59:55,852 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-querier-grpc) 2026-03-20 19:59:55,854 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-querier-http) 2026-03-20 19:59:55,856 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend-grpc) 2026-03-20 19:59:55,858 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend-http) 2026-03-20 19:59:55,861 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-public) 2026-03-20 19:59:55,885 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-internal"] ************************* 2026-03-20 19:59:55,885 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:55 +0000 (0:00:00.167) 0:00:13.446 ********** 2026-03-20 19:59:56,263 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:56,274 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-internal service is running in openstack namespace] *** 2026-03-20 19:59:56,274 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:56 +0000 (0:00:00.388) 0:00:13.835 ********** 2026-03-20 19:59:56,292 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-internal is running." } 2026-03-20 19:59:56,299 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-compactor-grpc"] ********* 2026-03-20 19:59:56,299 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:56 +0000 (0:00:00.025) 0:00:13.860 ********** 2026-03-20 19:59:56,711 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:56,718 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-compactor-grpc service is running in openstack namespace] *** 2026-03-20 19:59:56,718 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:56 +0000 (0:00:00.418) 0:00:14.279 ********** 2026-03-20 19:59:56,737 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-compactor-grpc is running." } 2026-03-20 19:59:56,744 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-compactor-http"] ********* 2026-03-20 19:59:56,744 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:56 +0000 (0:00:00.025) 0:00:14.305 ********** 2026-03-20 19:59:57,083 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:57,091 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-compactor-http service is running in openstack namespace] *** 2026-03-20 19:59:57,091 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:57 +0000 (0:00:00.347) 0:00:14.652 ********** 2026-03-20 19:59:57,107 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-compactor-http is running." } 2026-03-20 19:59:57,115 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-distributor-grpc"] ******* 2026-03-20 19:59:57,115 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:57 +0000 (0:00:00.023) 0:00:14.676 ********** 2026-03-20 19:59:57,542 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:57,553 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-distributor-grpc service is running in openstack namespace] *** 2026-03-20 19:59:57,553 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:57 +0000 (0:00:00.437) 0:00:15.114 ********** 2026-03-20 19:59:57,577 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-distributor-grpc is running." } 2026-03-20 19:59:57,586 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-distributor-http"] ******* 2026-03-20 19:59:57,586 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:57 +0000 (0:00:00.033) 0:00:15.147 ********** 2026-03-20 19:59:57,967 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:57,977 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-distributor-http service is running in openstack namespace] *** 2026-03-20 19:59:57,978 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:57 +0000 (0:00:00.391) 0:00:15.538 ********** 2026-03-20 19:59:57,994 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-distributor-http is running." } 2026-03-20 19:59:58,004 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-gateway-http"] *********** 2026-03-20 19:59:58,004 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:58 +0000 (0:00:00.026) 0:00:15.565 ********** 2026-03-20 19:59:58,355 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:58,362 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-gateway-http service is running in openstack namespace] *** 2026-03-20 19:59:58,363 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:58 +0000 (0:00:00.358) 0:00:15.923 ********** 2026-03-20 19:59:58,379 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-gateway-http is running." } 2026-03-20 19:59:58,387 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-gossip-ring"] ************ 2026-03-20 19:59:58,387 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:58 +0000 (0:00:00.024) 0:00:15.948 ********** 2026-03-20 19:59:58,699 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:58,707 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-gossip-ring service is running in openstack namespace] *** 2026-03-20 19:59:58,707 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:58 +0000 (0:00:00.320) 0:00:16.268 ********** 2026-03-20 19:59:58,722 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-gossip-ring is running." } 2026-03-20 19:59:58,729 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-index-gateway-grpc"] ***** 2026-03-20 19:59:58,729 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:58 +0000 (0:00:00.021) 0:00:16.290 ********** 2026-03-20 19:59:59,039 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:59,046 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-index-gateway-grpc service is running in openstack namespace] *** 2026-03-20 19:59:59,046 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:59 +0000 (0:00:00.316) 0:00:16.607 ********** 2026-03-20 19:59:59,060 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-index-gateway-grpc is running." } 2026-03-20 19:59:59,067 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-index-gateway-http"] ***** 2026-03-20 19:59:59,067 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:59 +0000 (0:00:00.021) 0:00:16.628 ********** 2026-03-20 19:59:59,384 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:59,391 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-index-gateway-http service is running in openstack namespace] *** 2026-03-20 19:59:59,392 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:59 +0000 (0:00:00.324) 0:00:16.952 ********** 2026-03-20 19:59:59,408 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-index-gateway-http is running." } 2026-03-20 19:59:59,415 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-ingester-grpc"] ********** 2026-03-20 19:59:59,415 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:59 +0000 (0:00:00.023) 0:00:16.976 ********** 2026-03-20 19:59:59,722 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 19:59:59,731 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-ingester-grpc service is running in openstack namespace] *** 2026-03-20 19:59:59,731 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:59 +0000 (0:00:00.316) 0:00:17.292 ********** 2026-03-20 19:59:59,749 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-ingester-grpc is running." } 2026-03-20 19:59:59,756 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-ingester-http"] ********** 2026-03-20 19:59:59,756 p=37253 u=zuul n=ansible | Friday 20 March 2026 19:59:59 +0000 (0:00:00.024) 0:00:17.317 ********** 2026-03-20 20:00:00,073 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:00,080 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-ingester-http service is running in openstack namespace] *** 2026-03-20 20:00:00,080 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:00 +0000 (0:00:00.324) 0:00:17.641 ********** 2026-03-20 20:00:00,094 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-ingester-http is running." } 2026-03-20 20:00:00,102 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-querier-grpc"] *********** 2026-03-20 20:00:00,102 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:00 +0000 (0:00:00.021) 0:00:17.663 ********** 2026-03-20 20:00:00,484 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:00,494 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-querier-grpc service is running in openstack namespace] *** 2026-03-20 20:00:00,494 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:00 +0000 (0:00:00.391) 0:00:18.055 ********** 2026-03-20 20:00:00,513 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-querier-grpc is running." } 2026-03-20 20:00:00,523 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-querier-http"] *********** 2026-03-20 20:00:00,524 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:00 +0000 (0:00:00.029) 0:00:18.084 ********** 2026-03-20 20:00:00,859 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:00,868 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-querier-http service is running in openstack namespace] *** 2026-03-20 20:00:00,868 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:00 +0000 (0:00:00.344) 0:00:18.429 ********** 2026-03-20 20:00:00,885 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-querier-http is running." } 2026-03-20 20:00:00,894 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-query-frontend-grpc"] **** 2026-03-20 20:00:00,895 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:00 +0000 (0:00:00.026) 0:00:18.455 ********** 2026-03-20 20:00:01,220 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:01,228 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-query-frontend-grpc service is running in openstack namespace] *** 2026-03-20 20:00:01,228 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:01 +0000 (0:00:00.333) 0:00:18.788 ********** 2026-03-20 20:00:01,243 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-query-frontend-grpc is running." } 2026-03-20 20:00:01,249 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-query-frontend-http"] **** 2026-03-20 20:00:01,250 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:01 +0000 (0:00:00.021) 0:00:18.810 ********** 2026-03-20 20:00:01,586 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:01,594 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-query-frontend-http service is running in openstack namespace] *** 2026-03-20 20:00:01,595 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:01 +0000 (0:00:00.345) 0:00:19.155 ********** 2026-03-20 20:00:01,610 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-query-frontend-http is running." } 2026-03-20 20:00:01,618 p=37253 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-public"] *************************** 2026-03-20 20:00:01,618 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:01 +0000 (0:00:00.023) 0:00:19.178 ********** 2026-03-20 20:00:01,941 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:01,948 p=37253 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-public service is running in openstack namespace] *** 2026-03-20 20:00:01,948 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:01 +0000 (0:00:00.330) 0:00:19.509 ********** 2026-03-20 20:00:01,965 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-public is running." } 2026-03-20 20:00:01,971 p=37253 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-20 20:00:01,971 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:01 +0000 (0:00:00.023) 0:00:19.532 ********** 2026-03-20 20:00:01,987 p=37253 u=zuul n=ansible | skipping: [localhost] 2026-03-20 20:00:01,994 p=37253 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-20 20:00:01,994 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:01 +0000 (0:00:00.022) 0:00:19.554 ********** 2026-03-20 20:00:02,009 p=37253 u=zuul n=ansible | skipping: [localhost] 2026-03-20 20:00:02,016 p=37253 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-20 20:00:02,016 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:02 +0000 (0:00:00.022) 0:00:19.577 ********** 2026-03-20 20:00:02,034 p=37253 u=zuul n=ansible | skipping: [localhost] 2026-03-20 20:00:02,041 p=37253 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-20 20:00:02,041 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:02 +0000 (0:00:00.024) 0:00:19.602 ********** 2026-03-20 20:00:02,057 p=37253 u=zuul n=ansible | skipping: [localhost] 2026-03-20 20:00:02,063 p=37253 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-20 20:00:02,063 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:02 +0000 (0:00:00.022) 0:00:19.624 ********** 2026-03-20 20:00:02,078 p=37253 u=zuul n=ansible | skipping: [localhost] 2026-03-20 20:00:02,086 p=37253 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-20 20:00:02,086 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:02 +0000 (0:00:00.022) 0:00:19.647 ********** 2026-03-20 20:00:02,113 p=37253 u=zuul n=ansible | skipping: [localhost] 2026-03-20 20:00:02,127 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Validate Chargeback Feature deployed correctly] *** 2026-03-20 20:00:02,127 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:02 +0000 (0:00:00.040) 0:00:19.688 ********** 2026-03-20 20:00:02,155 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/chargeback_tests.yml for localhost 2026-03-20 20:00:02,169 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Enable CloudKitty module (hashmap)] *************** 2026-03-20 20:00:02,169 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:02 +0000 (0:00:00.042) 0:00:19.730 ********** 2026-03-20 20:00:05,510 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:00:05,525 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Find the current value of hashmap] **************** 2026-03-20 20:00:05,525 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:05 +0000 (0:00:03.355) 0:00:23.086 ********** 2026-03-20 20:00:08,050 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:08,059 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Change priority for CloudKitty hashmap module] **** 2026-03-20 20:00:08,060 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:08 +0000 (0:00:02.534) 0:00:25.620 ********** 2026-03-20 20:00:11,397 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:00:11,403 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Get status of all CloudKitty rating modules] ****** 2026-03-20 20:00:11,403 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:11 +0000 (0:00:03.343) 0:00:28.964 ********** 2026-03-20 20:00:13,584 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:13,592 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Validate CloudKitty module states] *********** 2026-03-20 20:00:13,592 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:13 +0000 (0:00:02.188) 0:00:31.153 ********** 2026-03-20 20:00:13,621 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "SUCCESS: CloudKitty modules (hashmap=True) are configured correctly." } 2026-03-20 20:00:13,637 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Set priority for CloudKitty hashmap module] *** 2026-03-20 20:00:13,638 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:13 +0000 (0:00:00.045) 0:00:31.199 ********** 2026-03-20 20:00:13,655 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "SUCCESS: The hashmap priority is set to 100" } 2026-03-20 20:00:13,661 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Setup Loki Environment] *************************** 2026-03-20 20:00:13,661 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:13 +0000 (0:00:00.023) 0:00:31.222 ********** 2026-03-20 20:00:13,682 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/setup_loki_env.yml for localhost 2026-03-20 20:00:13,693 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Get Loki Public Route Host] *********************** 2026-03-20 20:00:13,693 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:13 +0000 (0:00:00.031) 0:00:31.254 ********** 2026-03-20 20:00:14,018 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:14,025 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Set Loki URLs] ************************************ 2026-03-20 20:00:14,025 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:14 +0000 (0:00:00.331) 0:00:31.586 ********** 2026-03-20 20:00:14,038 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:14,046 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Set Derived Loki URLs] **************************** 2026-03-20 20:00:14,046 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:14 +0000 (0:00:00.020) 0:00:31.607 ********** 2026-03-20 20:00:14,059 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:14,067 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Debug URLs] *************************************** 2026-03-20 20:00:14,067 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:14 +0000 (0:00:00.021) 0:00:31.628 ********** 2026-03-20 20:00:14,083 p=37253 u=zuul n=ansible | ok: [localhost] => { "msg": [ "Loki Route: https://cloudkitty-lokistack-openstack.apps-crc.testing", "Push URL: https://cloudkitty-lokistack-openstack.apps-crc.testing/api/logs/v1/cloudkitty/loki/api/v1/push", "Flush URL: https://cloudkitty-lokistack-ingester-http.openstack.svc:3100/flush", "Query URL: https://cloudkitty-lokistack-openstack.apps-crc.testing/api/logs/v1/cloudkitty/loki/api/v1/query_range" ] } 2026-03-20 20:00:14,091 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Ensure Local Certificate Directory Exists] ******** 2026-03-20 20:00:14,091 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:14 +0000 (0:00:00.023) 0:00:31.652 ********** 2026-03-20 20:00:14,405 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:00:14,413 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Extract Certificates from OpenShift Secret] ******* 2026-03-20 20:00:14,413 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:14 +0000 (0:00:00.322) 0:00:31.974 ********** 2026-03-20 20:00:14,727 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:00:14,736 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Extract Client Certificates] ********************** 2026-03-20 20:00:14,736 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:14 +0000 (0:00:00.323) 0:00:32.297 ********** 2026-03-20 20:00:15,067 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:00:15,074 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Extract CA Bundle] ******************************** 2026-03-20 20:00:15,075 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:15 +0000 (0:00:00.338) 0:00:32.635 ********** 2026-03-20 20:00:15,358 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:00:15,366 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : CloudKitty debug ON] ****************************** 2026-03-20 20:00:15,366 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:15 +0000 (0:00:00.291) 0:00:32.926 ********** 2026-03-20 20:00:15,374 p=37253 u=zuul n=ansible | skipping: [localhost] 2026-03-20 20:00:15,381 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : CloudKitty debug OFF] ***************************** 2026-03-20 20:00:15,381 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:15 +0000 (0:00:00.015) 0:00:32.942 ********** 2026-03-20 20:00:15,393 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:15,401 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Get admin project ID for CI] ********************** 2026-03-20 20:00:15,401 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:15 +0000 (0:00:00.019) 0:00:32.962 ********** 2026-03-20 20:00:17,529 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:17,544 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Set admin project ID for CI] ********************** 2026-03-20 20:00:17,544 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:17 +0000 (0:00:02.142) 0:00:35.105 ********** 2026-03-20 20:00:17,573 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:17,582 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Get admin user ID for CI] ************************* 2026-03-20 20:00:17,582 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:17 +0000 (0:00:00.037) 0:00:35.143 ********** 2026-03-20 20:00:19,873 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:19,881 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Set admin user ID for CI] ************************* 2026-03-20 20:00:19,881 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:19 +0000 (0:00:02.299) 0:00:37.442 ********** 2026-03-20 20:00:19,903 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:19,911 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Find test files] ********************************** 2026-03-20 20:00:19,911 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:19 +0000 (0:00:00.030) 0:00:37.472 ********** 2026-03-20 20:00:20,223 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:20,231 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Extract only the filenames into a clean list] ***** 2026-03-20 20:00:20,231 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:20 +0000 (0:00:00.319) 0:00:37.792 ********** 2026-03-20 20:00:20,251 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:20,258 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Process and Loop if files exist] ****************** 2026-03-20 20:00:20,258 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:20 +0000 (0:00:00.027) 0:00:37.819 ********** 2026-03-20 20:00:20,290 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/run_test_scenarios.yml for localhost => (item=test_dyn_basic) 2026-03-20 20:00:20,299 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Generate Synthetic Data for each file: test_dyn_basic] *** 2026-03-20 20:00:20,299 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:20 +0000 (0:00:00.040) 0:00:37.860 ********** 2026-03-20 20:00:20,328 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/gen_synth_loki_data.yml for localhost 2026-03-20 20:00:20,342 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Set variables dynamically for test_dyn_basic] ***** 2026-03-20 20:00:20,342 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:20 +0000 (0:00:00.043) 0:00:37.903 ********** 2026-03-20 20:00:20,366 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:20,374 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Check for preexisting output file] **************** 2026-03-20 20:00:20,374 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:20 +0000 (0:00:00.031) 0:00:37.935 ********** 2026-03-20 20:00:20,743 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:20,751 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Generate Synthetic Data for test_dyn_basic] ******* 2026-03-20 20:00:20,751 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:20 +0000 (0:00:00.376) 0:00:38.312 ********** 2026-03-20 20:00:21,145 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:00:21,154 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Generate chargeback rating from synthetic data file test_dyn_basic] *** 2026-03-20 20:00:21,154 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:21 +0000 (0:00:00.402) 0:00:38.715 ********** 2026-03-20 20:00:21,431 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:00:21,438 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Load metrics from YAML file] ********************** 2026-03-20 20:00:21,438 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:21 +0000 (0:00:00.284) 0:00:38.999 ********** 2026-03-20 20:00:21,454 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:21,461 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Load data to Loki: test_dyn_basic] **************** 2026-03-20 20:00:21,462 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:21 +0000 (0:00:00.023) 0:00:39.022 ********** 2026-03-20 20:00:21,485 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/load_loki_data.yml for localhost 2026-03-20 20:00:21,499 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Ingest CloudKitty data log for test_dyn_basic] **** 2026-03-20 20:00:21,499 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:21 +0000 (0:00:00.037) 0:00:39.060 ********** 2026-03-20 20:00:21,530 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/ingest_loki_data.yml for localhost 2026-03-20 20:00:21,540 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Read log file content] **************************** 2026-03-20 20:00:21,540 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:21 +0000 (0:00:00.040) 0:00:39.101 ********** 2026-03-20 20:00:21,928 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:21,938 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Push data to Loki] ******************************** 2026-03-20 20:00:21,938 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:21 +0000 (0:00:00.397) 0:00:39.499 ********** 2026-03-20 20:00:22,692 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:22,700 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Confirm ingestion success] ************************ 2026-03-20 20:00:22,701 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:22 +0000 (0:00:00.762) 0:00:40.261 ********** 2026-03-20 20:00:22,714 p=37253 u=zuul n=ansible | ok: [localhost] => { "msg": "Ingestion Successful!" } 2026-03-20 20:00:22,722 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Flush data to Loki storage for test_dyn_basic] **** 2026-03-20 20:00:22,722 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:22 +0000 (0:00:00.021) 0:00:40.282 ********** 2026-03-20 20:00:22,741 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/flush_loki_data.yml for localhost 2026-03-20 20:00:22,753 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Create directory inside OpenStack CLI] ************ 2026-03-20 20:00:22,753 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:22 +0000 (0:00:00.031) 0:00:40.314 ********** 2026-03-20 20:00:23,198 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:23,205 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Create directory to extract certificates] ********* 2026-03-20 20:00:23,205 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:23 +0000 (0:00:00.451) 0:00:40.766 ********** 2026-03-20 20:00:23,544 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:00:23,551 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Copy certificates to OpenStack CLI] *************** 2026-03-20 20:00:23,551 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:23 +0000 (0:00:00.345) 0:00:41.111 ********** 2026-03-20 20:00:24,261 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:00:24,271 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Trigger Loki ingester flush] ********************** 2026-03-20 20:00:24,271 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:24 +0000 (0:00:00.720) 0:00:41.832 ********** 2026-03-20 20:00:24,746 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:00:24,754 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Verify flush status] ****************************** 2026-03-20 20:00:24,754 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:24 +0000 (0:00:00.482) 0:00:42.315 ********** 2026-03-20 20:00:24,780 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "Ingester Memory Flushed successfully" } 2026-03-20 20:00:24,788 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Retrieve data log from Loki for test_dyn_basic] *** 2026-03-20 20:00:24,788 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:24 +0000 (0:00:00.033) 0:00:42.349 ********** 2026-03-20 20:00:24,814 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/retrieve_loki_data.yml for localhost 2026-03-20 20:00:24,835 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Expected Count test_dyn_basic] ******************** 2026-03-20 20:00:24,835 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:24 +0000 (0:00:00.047) 0:00:42.396 ********** 2026-03-20 20:00:24,853 p=37253 u=zuul n=ansible | ok: [localhost] => { "msg": "Input file has 42 data entries that Loki has to return" } 2026-03-20 20:00:24,859 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Query Loki API] *********************************** 2026-03-20 20:00:24,859 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:00:24 +0000 (0:00:00.023) 0:00:42.420 ********** 2026-03-20 20:17:34,320 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:17:34,338 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Save Loki Data to JSON file] ********************** 2026-03-20 20:17:34,338 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:34 +0000 (0:17:09.478) 0:17:51.899 ********** 2026-03-20 20:17:34,855 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:17:34,868 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Verify Data Integrity test_dyn_basic] ************* 2026-03-20 20:17:34,868 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:34 +0000 (0:00:00.530) 0:17:52.429 ********** 2026-03-20 20:17:34,901 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "Query returned all data entries. Input file had 42 entries and Loki returned 42" } 2026-03-20 20:17:34,912 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Generate chargeback stats from Loki-retrieved data file: test_dyn_basic] *** 2026-03-20 20:17:34,912 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:34 +0000 (0:00:00.043) 0:17:52.473 ********** 2026-03-20 20:17:35,183 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:17:35,191 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Get total rate from Loki: test_dyn_basic] ********* 2026-03-20 20:17:35,192 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:35 +0000 (0:00:00.279) 0:17:52.752 ********** 2026-03-20 20:17:35,212 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/loki_rate.yml for localhost 2026-03-20 20:17:35,233 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Get rating summary help 2] ************************ 2026-03-20 20:17:35,233 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:35 +0000 (0:00:00.041) 0:17:52.794 ********** 2026-03-20 20:17:37,044 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:17:37,052 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : **INFO** Print rating help 2] ********************* 2026-03-20 20:17:37,052 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:37 +0000 (0:00:01.818) 0:17:54.613 ********** 2026-03-20 20:17:37,067 p=37253 u=zuul n=ansible | ok: [localhost] => { "get_help2.stdout": "usage: openstack rating summary get [-h]\n [-f {csv,df-to-csv,json,table,value,yaml}]\n [-c COLUMN]\n [--quote {all,minimal,none,nonnumeric}]\n [--noindent] [--max-width ]\n [--fit-width] [--print-empty]\n [--format-config-file FORMAT_CONFIG]\n [--sort-column SORT_COLUMN]\n [--sort-ascending | --sort-descending]\n [--offset OFFSET] [--limit LIMIT]\n [-g GROUPBY] [--filter FILTER] [-b BEGIN]\n [-e END]\n\nGet a summary for a given period.\n\noptional arguments:\n -h, --help show this help message and exit\n --offset OFFSET Index of the first element\n --limit LIMIT Maximal number of elements\n -g GROUPBY, --groupby GROUPBY\n Attribute to group the summary by. Can be specified\n several times\n --filter FILTER Optional filter, in 'key:value' format. Can be\n specified several times.\n -b BEGIN, --begin BEGIN\n Start of the period to query, in iso8601 format.\n Example: 2019-05-01T00:00:00Z.\n -e END, --end END End of the period to query, in iso8601 format.\n Example: 2019-06-01T00:00:00Z.\n\noutput formatters:\n output formatter options\n\n -f {csv,df-to-csv,json,table,value,yaml}, --format {csv,df-to-csv,json,table,value,yaml}\n the output format, defaults to table\n -c COLUMN, --column COLUMN\n specify the column(s) to include, can be repeated to\n show multiple columns\n --sort-column SORT_COLUMN\n specify the column(s) to sort the data (columns\n specified first have a priority, non-existing columns\n are ignored), can be repeated\n --sort-ascending sort the column(s) in ascending order\n --sort-descending sort the column(s) in descending order\n\nCSV Formatter:\n --quote {all,minimal,none,nonnumeric}\n when to include quotes, defaults to nonnumeric\n\njson formatter:\n --noindent whether to disable indenting the JSON\n\ntable formatter:\n --max-width \n Maximum display width, <1 to disable. You can also use\n the CLIFF_MAX_TERM_WIDTH environment variable, but the\n parameter takes precedence.\n --fit-width Fit the table to the display width. Implied if --max-\n width greater than 0. Set the environment variable\n CLIFF_FIT_WIDTH=1 to always enable\n --print-empty Print empty table if there is no data to show.\n\ndataframe-to-csv formatter:\n --format-config-file FORMAT_CONFIG\n Config file for the dict-to-csv formatter\n\nThis command is provided by the python-cloudkittyclient plugin." } 2026-03-20 20:17:37,074 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Get Rate and Qty by type from CloudKitty test_dyn_basic] *** 2026-03-20 20:17:37,074 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:37 +0000 (0:00:00.022) 0:17:54.635 ********** 2026-03-20 20:17:43,695 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:17:43,706 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : **INFO** Print the rating by type test_dyn_basic] *** 2026-03-20 20:17:43,706 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:43 +0000 (0:00:06.631) 0:18:01.267 ********** 2026-03-20 20:17:43,722 p=37253 u=zuul n=ansible | ok: [localhost] => { "cost_totals_by_type.stdout": "+---------------------------+---------------------------+-------+------+-----------------------------------+\n| Begin | End | Qty | Rate | Type |\n+---------------------------+---------------------------+-------+------+-----------------------------------+\n| 2026-03-01T00:00:00+00:00 | 2026-04-01T00:00:00+00:00 | 0.0 | 0.0 | ceilometer_network_incoming_bytes |\n| 2026-03-01T00:00:00+00:00 | 2026-04-01T00:00:00+00:00 | 0.0 | 0.0 | ceilometer_disk_root_size |\n| 2026-03-01T00:00:00+00:00 | 2026-04-01T00:00:00+00:00 | 0.0 | 3.0 | ceilometer_ip_floating |\n| 2026-03-01T00:00:00+00:00 | 2026-04-01T00:00:00+00:00 | 0.0 | 0.0 | ceilometer_network_outgoing_bytes |\n| 2026-03-01T00:00:00+00:00 | 2026-04-01T00:00:00+00:00 | 6.0 | 1.8 | ceilometer_cpu |\n| 2026-03-01T00:00:00+00:00 | 2026-04-01T00:00:00+00:00 | 148.7 | 0.28 | ceilometer_image_size |\n| 2026-03-01T00:00:00+00:00 | 2026-04-01T00:00:00+00:00 | 0.0 | 0.0 | ceilometer_disk_ephemeral_size |\n+---------------------------+---------------------------+-------+------+-----------------------------------+" } 2026-03-20 20:17:43,733 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Save output as a loadable variable file test_dyn_basic] *** 2026-03-20 20:17:43,733 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:43 +0000 (0:00:00.026) 0:18:01.294 ********** 2026-03-20 20:17:44,089 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:17:44,099 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Get Rate and Qty Summary from CloudKitty test_dyn_basic] *** 2026-03-20 20:17:44,099 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:44 +0000 (0:00:00.365) 0:18:01.660 ********** 2026-03-20 20:17:49,588 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:17:49,596 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : **INFO** Print the rating summary test_dyn_basic] *** 2026-03-20 20:17:49,596 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:49 +0000 (0:00:05.497) 0:18:07.157 ********** 2026-03-20 20:17:49,611 p=37253 u=zuul n=ansible | ok: [localhost] => { "cost_totals_summary.stdout": "+---------------------------+---------------------------+-------+-------------------+\n| Begin | End | Qty | Rate |\n+---------------------------+---------------------------+-------+-------------------+\n| 2026-03-01T00:00:00+00:00 | 2026-04-01T00:00:00+00:00 | 154.7 | 5.079999999999999 |\n+---------------------------+---------------------------+-------+-------------------+" } 2026-03-20 20:17:49,618 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Check synthetic totals file exists] *************** 2026-03-20 20:17:49,618 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:49 +0000 (0:00:00.021) 0:18:07.179 ********** 2026-03-20 20:17:49,806 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:17:49,813 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Check Loki totals file exists] ******************** 2026-03-20 20:17:49,813 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:49 +0000 (0:00:00.195) 0:18:07.374 ********** 2026-03-20 20:17:49,998 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:17:50,008 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Totals files exist test_dyn_basic] *********** 2026-03-20 20:17:50,008 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:50 +0000 (0:00:00.194) 0:18:07.569 ********** 2026-03-20 20:17:50,033 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "PASSED! Required file(s) exist test_dyn_basic:\n- /home/zuul/ci-framework-data/artifacts/test_dyn_basic-synth_metrics_summary.yml\n- /home/zuul/ci-framework-data/artifacts/test_dyn_basic-loki_metrics_summary.yml\n" } 2026-03-20 20:17:50,039 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Read the synthetic totals file] ******************* 2026-03-20 20:17:50,039 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:50 +0000 (0:00:00.031) 0:18:07.600 ********** 2026-03-20 20:17:50,236 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:17:50,247 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Read Loki totals YAML file] *********************** 2026-03-20 20:17:50,247 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:50 +0000 (0:00:00.207) 0:18:07.808 ********** 2026-03-20 20:17:50,443 p=37253 u=zuul n=ansible | ok: [localhost] 2026-03-20 20:17:50,454 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Compare synthetic data vs Loki data results test_dyn_basic] *** 2026-03-20 20:17:50,454 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:50 +0000 (0:00:00.206) 0:18:08.014 ********** 2026-03-20 20:17:50,472 p=37253 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "PASSED! test_dyn_basic - Data totals are identical." } 2026-03-20 20:17:50,481 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Cleanup after job run] **************************** 2026-03-20 20:17:50,481 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:50 +0000 (0:00:00.027) 0:18:08.042 ********** 2026-03-20 20:17:50,500 p=37253 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/cleanup_ck.yml for localhost 2026-03-20 20:17:50,513 p=37253 u=zuul n=ansible | TASK [telemetry_chargeback : Cleanup local certificates] *********************** 2026-03-20 20:17:50,514 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:50 +0000 (0:00:00.032) 0:18:08.074 ********** 2026-03-20 20:17:50,722 p=37253 u=zuul n=ansible | changed: [localhost] 2026-03-20 20:17:50,764 p=37253 u=zuul n=ansible | PLAY RECAP ********************************************************************* 2026-03-20 20:17:50,764 p=37253 u=zuul n=ansible | localhost : ok=148 changed=16 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-20 20:17:50,774 p=37253 u=zuul n=ansible | Friday 20 March 2026 20:17:50 +0000 (0:00:00.260) 0:18:08.335 ********** 2026-03-20 20:17:50,774 p=37253 u=zuul n=ansible | =============================================================================== 2026-03-20 20:17:50,774 p=37253 u=zuul n=ansible | telemetry_chargeback : Query Loki API -------------------------------- 1029.48s 2026-03-20 20:17:50,774 p=37253 u=zuul n=ansible | telemetry_chargeback : TEST Get Rate and Qty by type from CloudKitty test_dyn_basic --- 6.63s 2026-03-20 20:17:50,774 p=37253 u=zuul n=ansible | telemetry_chargeback : TEST Get Rate and Qty Summary from CloudKitty test_dyn_basic --- 5.50s 2026-03-20 20:17:50,774 p=37253 u=zuul n=ansible | telemetry_chargeback : Enable CloudKitty module (hashmap) --------------- 3.36s 2026-03-20 20:17:50,774 p=37253 u=zuul n=ansible | telemetry_chargeback : Change priority for CloudKitty hashmap module ---- 3.34s 2026-03-20 20:17:50,774 p=37253 u=zuul n=ansible | telemetry_chargeback : Find the current value of hashmap ---------------- 2.53s 2026-03-20 20:17:50,774 p=37253 u=zuul n=ansible | common : Verify endpoint "['cloudkitty', 'rating', 'internal']" --------- 2.45s 2026-03-20 20:17:50,774 p=37253 u=zuul n=ansible | telemetry_chargeback : Get admin user ID for CI ------------------------- 2.30s 2026-03-20 20:17:50,774 p=37253 u=zuul n=ansible | common : Verify endpoint "['cloudkitty', 'rating', 'public']" ----------- 2.25s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | telemetry_chargeback : Get status of all CloudKitty rating modules ------ 2.19s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | telemetry_chargeback : Get admin project ID for CI ---------------------- 2.14s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | telemetry_chargeback : Get rating summary help 2 ------------------------ 1.82s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 1.08s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | telemetry_chargeback : Push data to Loki -------------------------------- 0.76s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | telemetry_chargeback : Copy certificates to OpenStack CLI --------------- 0.72s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | telemetry_chargeback : Save Loki Data to JSON file ---------------------- 0.53s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.50s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | telemetry_chargeback : Trigger Loki ingester flush ---------------------- 0.48s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | telemetry_chargeback : Create directory inside OpenStack CLI ------------ 0.45s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.45s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.45s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.44s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-distributor-grpc" ------- 0.44s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-compactor-grpc" --------- 0.42s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-querier pod is Running in openstack namespace --- 0.41s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | telemetry_chargeback : Generate Synthetic Data for test_dyn_basic ------- 0.40s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.40s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | telemetry_chargeback : Read log file content ---------------------------- 0.40s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Get the openstack-operators project ---------------------------- 0.40s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.39s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-querier-grpc" ----------- 0.39s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-distributor-http" ------- 0.39s 2026-03-20 20:17:50,775 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-internal" ------------------------- 0.39s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : Get the openstack project -------------------------------------- 0.38s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-compactor pod is Running in openstack namespace --- 0.38s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.38s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | telemetry_chargeback : Check for preexisting output file ---------------- 0.38s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.38s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : TEST Check cloudkitty-proc pod is Running in openstack namespace --- 0.37s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | telemetry_chargeback : Save output as a loadable variable file test_dyn_basic --- 0.37s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-gateway-http" ----------- 0.36s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : TEST Check cloudkitty-api pod is Running in openstack namespace --- 0.35s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-ingester pod is Running in openstack namespace --- 0.35s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-compactor-http" --------- 0.35s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | telemetry_chargeback : Create directory to extract certificates --------- 0.35s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-query-frontend-http" ---- 0.35s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-querier-http" ----------- 0.34s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-query-frontend pod is Running in openstack namespace --- 0.34s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-distributor pod is Running in openstack namespace --- 0.34s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-index-gateway pod is Running in openstack namespace --- 0.34s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | telemetry_chargeback : Extract Client Certificates ---------------------- 0.34s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-query-frontend-grpc" ---- 0.33s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | telemetry_chargeback : Get Loki Public Route Host ----------------------- 0.33s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-public" --------------------------- 0.33s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-ingester-http" ---------- 0.32s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-index-gateway-http" ----- 0.32s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | telemetry_chargeback : Extract Certificates from OpenShift Secret ------- 0.32s 2026-03-20 20:17:50,776 p=37253 u=zuul n=ansible | telemetry_chargeback : Ensure Local Certificate Directory Exists -------- 0.32s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-gossip-ring" ------------ 0.32s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Find test files ---------------------------------- 0.32s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-index-gateway-grpc" ----- 0.32s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-ingester-grpc" ---------- 0.32s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Extract CA Bundle -------------------------------- 0.29s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Generate chargeback rating from synthetic data file test_dyn_basic --- 0.28s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Generate chargeback stats from Loki-retrieved data file: test_dyn_basic --- 0.28s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Cleanup local certificates ----------------------- 0.26s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Read the synthetic totals file ------------------- 0.21s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Read Loki totals YAML file ----------------------- 0.21s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Check synthetic totals file exists --------------- 0.20s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Check Loki totals file exists -------------------- 0.19s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.17s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.15s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.07s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.05s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Retrieve data log from Loki for test_dyn_basic --- 0.05s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : TEST Validate CloudKitty module states ----------- 0.05s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Verify Data Integrity test_dyn_basic ------------- 0.04s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Generate Synthetic Data for each file: test_dyn_basic --- 0.04s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Validate Chargeback Feature deployed correctly --- 0.04s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Get total rate from Loki: test_dyn_basic --------- 0.04s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | common : TEST Check that cloudkitty public endpoint exists ------------- 0.04s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-20 20:17:50,777 p=37253 u=zuul n=ansible | telemetry_chargeback : Ingest CloudKitty data log for test_dyn_basic ---- 0.04s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : Process and Loop if files exist ------------------ 0.04s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : Set admin project ID for CI ---------------------- 0.04s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : Load data to Loki: test_dyn_basic ---------------- 0.04s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | common : TEST Check that cloudkitty internal endpoint exists ----------- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : Verify flush status ------------------------------ 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-distributor-grpc service is running in openstack namespace --- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : Cleanup after job run ---------------------------- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : Set variables dynamically for test_dyn_basic ----- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : Setup Loki Environment --------------------------- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : TEST Totals files exist test_dyn_basic ----------- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : Flush data to Loki storage for test_dyn_basic ---- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : Set admin user ID for CI ------------------------- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-querier-grpc service is running in openstack namespace --- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : TEST Compare synthetic data vs Loki data results test_dyn_basic --- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : Extract only the filenames into a clean list ----- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | telemetry_chargeback : **INFO** Print the rating by type test_dyn_basic --- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-distributor-http service is running in openstack namespace --- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | common : TEST Verify openstack project exists -------------------------- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-querier-http service is running in openstack namespace --- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | common : TEST Verify openstack-operators project exists ---------------- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-compactor-grpc service is running in openstack namespace --- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-internal service is running in openstack namespace --- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-ingester-grpc service is running in openstack namespace --- 0.03s 2026-03-20 20:17:50,778 p=37253 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-gateway-http service is running in openstack namespace --- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-compactor-http service is running in openstack namespace --- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | telemetry_chargeback : Expected Count test_dyn_basic -------------------- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | telemetry_chargeback : Debug URLs --------------------------------------- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-index-gateway-http service is running in openstack namespace --- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | telemetry_chargeback : TEST Set priority for CloudKitty hashmap module --- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-public service is running in openstack namespace --- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | telemetry_chargeback : Load metrics from YAML file ---------------------- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-query-frontend-http service is running in openstack namespace --- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | telemetry_chargeback : **INFO** Print rating help 2 --------------------- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | telemetry_chargeback : **INFO** Print the rating summary test_dyn_basic --- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-ingester-http service is running in openstack namespace --- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-gossip-ring service is running in openstack namespace --- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-query-frontend-grpc service is running in openstack namespace --- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-index-gateway-grpc service is running in openstack namespace --- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | telemetry_chargeback : Set Derived Loki URLs ---------------------------- 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | telemetry_chargeback : Confirm ingestion success ------------------------ 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | telemetry_chargeback : Set Loki URLs ------------------------------------ 0.02s 2026-03-20 20:17:50,779 p=37253 u=zuul n=ansible | telemetry_chargeback : CloudKitty debug OFF ----------------------------- 0.02s