2026-03-18 14:47:04,372 p=37285 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace 2026-03-18 14:47:04,373 p=37285 u=zuul n=ansible | PLAY [Verify all the applicable projects, endpoints, pods & services for cloudkitty] *** 2026-03-18 14:47:04,383 p=37285 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-18 14:47:04,383 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:04 +0000 (0:00:00.027) 0:00:00.027 ******* 2026-03-18 14:47:05,324 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:05,344 p=37285 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 14:47:05,344 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:05 +0000 (0:00:00.960) 0:00:00.988 ******* 2026-03-18 14:47:05,415 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-api) 2026-03-18 14:47:05,418 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-compactor) 2026-03-18 14:47:05,420 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-distributor) 2026-03-18 14:47:05,423 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway) 2026-03-18 14:47:05,425 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-ingester) 2026-03-18 14:47:05,427 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-querier) 2026-03-18 14:47:05,430 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend) 2026-03-18 14:47:05,432 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for localhost => (item=cloudkitty-proc) 2026-03-18 14:47:05,441 p=37285 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 14:47:05,442 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:05 +0000 (0:00:00.097) 0:00:01.085 ******* 2026-03-18 14:47:05,894 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:05,903 p=37285 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-api pod is Running in openstack namespace] *** 2026-03-18 14:47:05,903 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:05 +0000 (0:00:00.461) 0:00:01.547 ******* 2026-03-18 14:47:06,244 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:06,252 p=37285 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 14:47:06,252 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:06 +0000 (0:00:00.348) 0:00:01.896 ******* 2026-03-18 14:47:06,641 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:06,650 p=37285 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-compactor pod is Running in openstack namespace] *** 2026-03-18 14:47:06,650 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:06 +0000 (0:00:00.397) 0:00:02.294 ******* 2026-03-18 14:47:07,036 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:07,044 p=37285 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 14:47:07,044 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:07 +0000 (0:00:00.393) 0:00:02.687 ******* 2026-03-18 14:47:07,483 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:07,493 p=37285 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-distributor pod is Running in openstack namespace] *** 2026-03-18 14:47:07,494 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:07 +0000 (0:00:00.449) 0:00:03.137 ******* 2026-03-18 14:47:07,852 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:07,860 p=37285 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 14:47:07,860 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:07 +0000 (0:00:00.366) 0:00:03.503 ******* 2026-03-18 14:47:08,211 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:08,219 p=37285 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-index-gateway pod is Running in openstack namespace] *** 2026-03-18 14:47:08,220 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:08 +0000 (0:00:00.359) 0:00:03.863 ******* 2026-03-18 14:47:08,530 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:08,540 p=37285 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 14:47:08,540 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:08 +0000 (0:00:00.319) 0:00:04.183 ******* 2026-03-18 14:47:08,934 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:08,942 p=37285 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-ingester pod is Running in openstack namespace] *** 2026-03-18 14:47:08,942 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:08 +0000 (0:00:00.402) 0:00:04.586 ******* 2026-03-18 14:47:09,276 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:09,284 p=37285 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 14:47:09,284 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:09 +0000 (0:00:00.342) 0:00:04.928 ******* 2026-03-18 14:47:09,676 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:09,687 p=37285 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-querier pod is Running in openstack namespace] *** 2026-03-18 14:47:09,687 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:09 +0000 (0:00:00.402) 0:00:05.330 ******* 2026-03-18 14:47:10,046 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:10,055 p=37285 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 14:47:10,055 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:10 +0000 (0:00:00.368) 0:00:05.699 ******* 2026-03-18 14:47:10,431 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:10,439 p=37285 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-lokistack-query-frontend pod is Running in openstack namespace] *** 2026-03-18 14:47:10,439 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:10 +0000 (0:00:00.384) 0:00:06.083 ******* 2026-03-18 14:47:10,762 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:10,769 p=37285 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 14:47:10,769 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:10 +0000 (0:00:00.329) 0:00:06.412 ******* 2026-03-18 14:47:11,142 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:11,152 p=37285 u=zuul n=ansible | TASK [common : TEST Check cloudkitty-proc pod is Running in openstack namespace] *** 2026-03-18 14:47:11,152 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:11 +0000 (0:00:00.383) 0:00:06.796 ******* 2026-03-18 14:47:11,510 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:11,517 p=37285 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 14:47:11,518 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:11 +0000 (0:00:00.365) 0:00:07.161 ******* 2026-03-18 14:47:11,535 p=37285 u=zuul n=ansible | skipping: [localhost] 2026-03-18 14:47:11,542 p=37285 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 14:47:11,542 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:11 +0000 (0:00:00.024) 0:00:07.186 ******* 2026-03-18 14:47:11,576 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for localhost => (item=['cloudkitty', 'rating', 'public']) 2026-03-18 14:47:11,579 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for localhost => (item=['cloudkitty', 'rating', 'internal']) 2026-03-18 14:47:11,601 p=37285 u=zuul n=ansible | TASK [common : Verify endpoint "['cloudkitty', 'rating', 'public']"] *********** 2026-03-18 14:47:11,602 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:11 +0000 (0:00:00.059) 0:00:07.245 ******* 2026-03-18 14:47:13,976 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:13,985 p=37285 u=zuul n=ansible | TASK [common : TEST Check that cloudkitty public endpoint exists] ************** 2026-03-18 14:47:13,985 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:13 +0000 (0:00:02.383) 0:00:09.628 ******* 2026-03-18 14:47:14,004 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "The endpoint cloudkitty is found." } 2026-03-18 14:47:14,012 p=37285 u=zuul n=ansible | TASK [common : Verify endpoint "['cloudkitty', 'rating', 'internal']"] ********* 2026-03-18 14:47:14,012 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:14 +0000 (0:00:00.026) 0:00:09.655 ******* 2026-03-18 14:47:16,346 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:16,357 p=37285 u=zuul n=ansible | TASK [common : TEST Check that cloudkitty internal endpoint exists] ************ 2026-03-18 14:47:16,357 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:16 +0000 (0:00:02.344) 0:00:12.000 ******* 2026-03-18 14:47:16,381 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "The endpoint cloudkitty is found." } 2026-03-18 14:47:16,391 p=37285 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 14:47:16,391 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:16 +0000 (0:00:00.034) 0:00:12.035 ******* 2026-03-18 14:47:16,428 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for localhost => (item=openstack) 2026-03-18 14:47:16,431 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for localhost => (item=openstack-operators) 2026-03-18 14:47:16,458 p=37285 u=zuul n=ansible | TASK [common : Get the openstack project] ************************************** 2026-03-18 14:47:16,458 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:16 +0000 (0:00:00.066) 0:00:12.102 ******* 2026-03-18 14:47:16,793 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:16,804 p=37285 u=zuul n=ansible | TASK [common : TEST Verify openstack project exists] *************************** 2026-03-18 14:47:16,804 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:16 +0000 (0:00:00.346) 0:00:12.448 ******* 2026-03-18 14:47:16,821 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "project openstack is found." } 2026-03-18 14:47:16,828 p=37285 u=zuul n=ansible | TASK [common : Get the openstack-operators project] **************************** 2026-03-18 14:47:16,828 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:16 +0000 (0:00:00.024) 0:00:12.472 ******* 2026-03-18 14:47:17,176 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:17,184 p=37285 u=zuul n=ansible | TASK [common : TEST Verify openstack-operators project exists] ***************** 2026-03-18 14:47:17,184 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:17 +0000 (0:00:00.355) 0:00:12.828 ******* 2026-03-18 14:47:17,201 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "project openstack-operators is found." } 2026-03-18 14:47:17,207 p=37285 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 14:47:17,208 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:17 +0000 (0:00:00.023) 0:00:12.851 ******* 2026-03-18 14:47:17,305 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-internal) 2026-03-18 14:47:17,307 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-compactor-grpc) 2026-03-18 14:47:17,309 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-compactor-http) 2026-03-18 14:47:17,311 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-distributor-grpc) 2026-03-18 14:47:17,313 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-distributor-http) 2026-03-18 14:47:17,315 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-gateway-http) 2026-03-18 14:47:17,317 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-gossip-ring) 2026-03-18 14:47:17,319 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway-grpc) 2026-03-18 14:47:17,321 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-index-gateway-http) 2026-03-18 14:47:17,323 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-ingester-grpc) 2026-03-18 14:47:17,325 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-ingester-http) 2026-03-18 14:47:17,327 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-querier-grpc) 2026-03-18 14:47:17,329 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-querier-http) 2026-03-18 14:47:17,332 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend-grpc) 2026-03-18 14:47:17,334 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-lokistack-query-frontend-http) 2026-03-18 14:47:17,336 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for localhost => (item=cloudkitty-public) 2026-03-18 14:47:17,361 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-internal"] ************************* 2026-03-18 14:47:17,362 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:17 +0000 (0:00:00.153) 0:00:13.005 ******* 2026-03-18 14:47:17,740 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:17,747 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-internal service is running in openstack namespace] *** 2026-03-18 14:47:17,748 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:17 +0000 (0:00:00.385) 0:00:13.391 ******* 2026-03-18 14:47:17,765 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-internal is running." } 2026-03-18 14:47:17,773 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-compactor-grpc"] ********* 2026-03-18 14:47:17,773 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:17 +0000 (0:00:00.025) 0:00:13.416 ******* 2026-03-18 14:47:18,112 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:18,120 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-compactor-grpc service is running in openstack namespace] *** 2026-03-18 14:47:18,120 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:18 +0000 (0:00:00.346) 0:00:13.763 ******* 2026-03-18 14:47:18,137 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-compactor-grpc is running." } 2026-03-18 14:47:18,146 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-compactor-http"] ********* 2026-03-18 14:47:18,146 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:18 +0000 (0:00:00.026) 0:00:13.790 ******* 2026-03-18 14:47:18,470 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:18,477 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-compactor-http service is running in openstack namespace] *** 2026-03-18 14:47:18,478 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:18 +0000 (0:00:00.331) 0:00:14.121 ******* 2026-03-18 14:47:18,498 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-compactor-http is running." } 2026-03-18 14:47:18,505 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-distributor-grpc"] ******* 2026-03-18 14:47:18,506 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:18 +0000 (0:00:00.027) 0:00:14.149 ******* 2026-03-18 14:47:18,839 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:18,849 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-distributor-grpc service is running in openstack namespace] *** 2026-03-18 14:47:18,849 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:18 +0000 (0:00:00.343) 0:00:14.493 ******* 2026-03-18 14:47:18,869 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-distributor-grpc is running." } 2026-03-18 14:47:18,876 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-distributor-http"] ******* 2026-03-18 14:47:18,876 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:18 +0000 (0:00:00.027) 0:00:14.520 ******* 2026-03-18 14:47:19,229 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:19,237 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-distributor-http service is running in openstack namespace] *** 2026-03-18 14:47:19,237 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:19 +0000 (0:00:00.360) 0:00:14.881 ******* 2026-03-18 14:47:19,255 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-distributor-http is running." } 2026-03-18 14:47:19,265 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-gateway-http"] *********** 2026-03-18 14:47:19,265 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:19 +0000 (0:00:00.027) 0:00:14.908 ******* 2026-03-18 14:47:19,589 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:19,598 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-gateway-http service is running in openstack namespace] *** 2026-03-18 14:47:19,598 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:19 +0000 (0:00:00.333) 0:00:15.242 ******* 2026-03-18 14:47:19,619 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-gateway-http is running." } 2026-03-18 14:47:19,628 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-gossip-ring"] ************ 2026-03-18 14:47:19,628 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:19 +0000 (0:00:00.029) 0:00:15.271 ******* 2026-03-18 14:47:19,971 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:19,979 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-gossip-ring service is running in openstack namespace] *** 2026-03-18 14:47:19,979 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:19 +0000 (0:00:00.351) 0:00:15.623 ******* 2026-03-18 14:47:19,996 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-gossip-ring is running." } 2026-03-18 14:47:20,003 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-index-gateway-grpc"] ***** 2026-03-18 14:47:20,003 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:20 +0000 (0:00:00.024) 0:00:15.647 ******* 2026-03-18 14:47:20,324 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:20,332 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-index-gateway-grpc service is running in openstack namespace] *** 2026-03-18 14:47:20,332 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:20 +0000 (0:00:00.328) 0:00:15.976 ******* 2026-03-18 14:47:20,354 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-index-gateway-grpc is running." } 2026-03-18 14:47:20,363 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-index-gateway-http"] ***** 2026-03-18 14:47:20,363 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:20 +0000 (0:00:00.030) 0:00:16.006 ******* 2026-03-18 14:47:20,698 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:20,707 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-index-gateway-http service is running in openstack namespace] *** 2026-03-18 14:47:20,707 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:20 +0000 (0:00:00.344) 0:00:16.350 ******* 2026-03-18 14:47:20,726 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-index-gateway-http is running." } 2026-03-18 14:47:20,733 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-ingester-grpc"] ********** 2026-03-18 14:47:20,733 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:20 +0000 (0:00:00.026) 0:00:16.377 ******* 2026-03-18 14:47:21,086 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:21,095 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-ingester-grpc service is running in openstack namespace] *** 2026-03-18 14:47:21,095 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:21 +0000 (0:00:00.361) 0:00:16.739 ******* 2026-03-18 14:47:21,113 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-ingester-grpc is running." } 2026-03-18 14:47:21,121 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-ingester-http"] ********** 2026-03-18 14:47:21,121 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:21 +0000 (0:00:00.025) 0:00:16.765 ******* 2026-03-18 14:47:21,438 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:21,447 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-ingester-http service is running in openstack namespace] *** 2026-03-18 14:47:21,448 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:21 +0000 (0:00:00.326) 0:00:17.091 ******* 2026-03-18 14:47:21,464 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-ingester-http is running." } 2026-03-18 14:47:21,471 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-querier-grpc"] *********** 2026-03-18 14:47:21,471 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:21 +0000 (0:00:00.023) 0:00:17.115 ******* 2026-03-18 14:47:21,794 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:21,802 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-querier-grpc service is running in openstack namespace] *** 2026-03-18 14:47:21,802 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:21 +0000 (0:00:00.330) 0:00:17.446 ******* 2026-03-18 14:47:21,820 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-querier-grpc is running." } 2026-03-18 14:47:21,829 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-querier-http"] *********** 2026-03-18 14:47:21,829 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:21 +0000 (0:00:00.026) 0:00:17.473 ******* 2026-03-18 14:47:22,146 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:22,154 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-querier-http service is running in openstack namespace] *** 2026-03-18 14:47:22,154 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:22 +0000 (0:00:00.324) 0:00:17.797 ******* 2026-03-18 14:47:22,174 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-querier-http is running." } 2026-03-18 14:47:22,182 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-query-frontend-grpc"] **** 2026-03-18 14:47:22,182 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:22 +0000 (0:00:00.028) 0:00:17.825 ******* 2026-03-18 14:47:22,535 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:22,543 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-query-frontend-grpc service is running in openstack namespace] *** 2026-03-18 14:47:22,543 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:22 +0000 (0:00:00.361) 0:00:18.187 ******* 2026-03-18 14:47:22,561 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-query-frontend-grpc is running." } 2026-03-18 14:47:22,568 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-lokistack-query-frontend-http"] **** 2026-03-18 14:47:22,568 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:22 +0000 (0:00:00.025) 0:00:18.212 ******* 2026-03-18 14:47:22,905 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:22,912 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-lokistack-query-frontend-http service is running in openstack namespace] *** 2026-03-18 14:47:22,912 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:22 +0000 (0:00:00.344) 0:00:18.556 ******* 2026-03-18 14:47:22,931 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-lokistack-query-frontend-http is running." } 2026-03-18 14:47:22,938 p=37285 u=zuul n=ansible | TASK [common : Verify Service - "cloudkitty-public"] *************************** 2026-03-18 14:47:22,938 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:22 +0000 (0:00:00.025) 0:00:18.581 ******* 2026-03-18 14:47:23,272 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:23,279 p=37285 u=zuul n=ansible | TASK [common : TEST Verify cloudkitty-public service is running in openstack namespace] *** 2026-03-18 14:47:23,279 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:23 +0000 (0:00:00.341) 0:00:18.923 ******* 2026-03-18 14:47:23,297 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "service cloudkitty-public is running." } 2026-03-18 14:47:23,304 p=37285 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 14:47:23,304 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:23 +0000 (0:00:00.024) 0:00:18.948 ******* 2026-03-18 14:47:23,321 p=37285 u=zuul n=ansible | skipping: [localhost] 2026-03-18 14:47:23,328 p=37285 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 14:47:23,328 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:23 +0000 (0:00:00.023) 0:00:18.971 ******* 2026-03-18 14:47:23,344 p=37285 u=zuul n=ansible | skipping: [localhost] 2026-03-18 14:47:23,350 p=37285 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 14:47:23,350 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:23 +0000 (0:00:00.022) 0:00:18.994 ******* 2026-03-18 14:47:23,367 p=37285 u=zuul n=ansible | skipping: [localhost] 2026-03-18 14:47:23,374 p=37285 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 14:47:23,374 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:23 +0000 (0:00:00.023) 0:00:19.018 ******* 2026-03-18 14:47:23,392 p=37285 u=zuul n=ansible | skipping: [localhost] 2026-03-18 14:47:23,398 p=37285 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 14:47:23,399 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:23 +0000 (0:00:00.024) 0:00:19.042 ******* 2026-03-18 14:47:23,416 p=37285 u=zuul n=ansible | skipping: [localhost] 2026-03-18 14:47:23,422 p=37285 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 14:47:23,422 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:23 +0000 (0:00:00.023) 0:00:19.066 ******* 2026-03-18 14:47:23,439 p=37285 u=zuul n=ansible | skipping: [localhost] 2026-03-18 14:47:23,457 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Validate Chargeback Feature] ********************** 2026-03-18 14:47:23,457 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:23 +0000 (0:00:00.034) 0:00:19.101 ******* 2026-03-18 14:47:23,475 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/chargeback_tests.yml for localhost 2026-03-18 14:47:23,483 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Enable Cloudkitty Module (hashmap)] *************** 2026-03-18 14:47:23,483 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:23 +0000 (0:00:00.026) 0:00:19.127 ******* 2026-03-18 14:47:27,205 p=37285 u=zuul n=ansible | changed: [localhost] 2026-03-18 14:47:27,224 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Find the current value of hashmap] **************** 2026-03-18 14:47:27,224 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:27 +0000 (0:00:03.740) 0:00:22.868 ******* 2026-03-18 14:47:29,825 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:29,833 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Change priority for CloudKitty hashmap module] **** 2026-03-18 14:47:29,833 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:29 +0000 (0:00:02.608) 0:00:25.477 ******* 2026-03-18 14:47:32,880 p=37285 u=zuul n=ansible | changed: [localhost] 2026-03-18 14:47:32,891 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Get status of all CloudKitty rating modules] ****** 2026-03-18 14:47:32,891 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:32 +0000 (0:00:03.058) 0:00:28.535 ******* 2026-03-18 14:47:35,060 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:35,076 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Validate CloudKitty module states] *********** 2026-03-18 14:47:35,076 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:35 +0000 (0:00:02.184) 0:00:30.720 ******* 2026-03-18 14:47:35,106 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "SUCCESS: CloudKitty modules (hashmap=True) are configured correctly." } 2026-03-18 14:47:35,116 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Set priority for CloudKitty hashmap module] *** 2026-03-18 14:47:35,116 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:35 +0000 (0:00:00.040) 0:00:30.760 ******* 2026-03-18 14:47:35,140 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "SUCCESS: The hashmap priority is set to 100" } 2026-03-18 14:47:35,151 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Validate CloudKitty Scope API (OSPRH-23754)] ****** 2026-03-18 14:47:35,152 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:35 +0000 (0:00:00.035) 0:00:30.795 ******* 2026-03-18 14:47:35,179 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/scope_api_tests.yml for localhost 2026-03-18 14:47:35,194 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Get OpenStack auth token] ************************* 2026-03-18 14:47:35,194 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:35 +0000 (0:00:00.042) 0:00:30.838 ******* 2026-03-18 14:47:38,026 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:38,035 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Get CloudKitty rating endpoint] ******************* 2026-03-18 14:47:38,035 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:38 +0000 (0:00:02.840) 0:00:33.679 ******* 2026-03-18 14:47:40,283 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:40,291 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Display CloudKitty endpoint] ********************** 2026-03-18 14:47:40,291 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:40 +0000 (0:00:02.255) 0:00:35.934 ******* 2026-03-18 14:47:40,305 p=37285 u=zuul n=ansible | ok: [localhost] => { "msg": "CloudKitty endpoint: https://cloudkitty-internal.openstack.svc:8889" } 2026-03-18 14:47:40,312 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Create a scope via the Scope API POST] ************ 2026-03-18 14:47:40,312 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:40 +0000 (0:00:00.021) 0:00:35.956 ******* 2026-03-18 14:47:40,811 p=37285 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": false, "content": "", "elapsed": 0, "msg": "Status code was -1 and not [200, 409]: Request failed: ", "redirected": false, "status": -1, "url": "https://cloudkitty-internal.openstack.svc:8889/v2/scope"} 2026-03-18 14:47:40,811 p=37285 u=zuul n=ansible | ...ignoring 2026-03-18 14:47:40,820 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : TEST RHOSO Verify CloudKitty Scope API POST creates a scope (OSPRH-23754)] *** 2026-03-18 14:47:40,821 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:40 +0000 (0:00:00.508) 0:00:36.464 ******* 2026-03-18 14:47:40,833 p=37285 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'json'. 'dict object' has no attribute 'json'\n\nThe error appears to be in '/home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/scope_api_tests.yml': line 44, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: TEST RHOSO Verify CloudKitty Scope API POST creates a scope (OSPRH-23754)\n ^ here\n"} 2026-03-18 14:47:40,833 p=37285 u=zuul n=ansible | ...ignoring 2026-03-18 14:47:40,843 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Retrieve scope via Scope API GET to confirm persistence] *** 2026-03-18 14:47:40,844 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:40 +0000 (0:00:00.022) 0:00:36.487 ******* 2026-03-18 14:47:41,204 p=37285 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": false, "content": "", "elapsed": 0, "msg": "Status code was -1 and not [200]: Request failed: ", "redirected": false, "status": -1, "url": "https://cloudkitty-internal.openstack.svc:8889/v2/scope"} 2026-03-18 14:47:41,204 p=37285 u=zuul n=ansible | ...ignoring 2026-03-18 14:47:41,211 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : TEST RHOSO Verify CloudKitty Scope API GET returns the created scope (OSPRH-23754)] *** 2026-03-18 14:47:41,211 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:41 +0000 (0:00:00.367) 0:00:36.855 ******* 2026-03-18 14:47:41,233 p=37285 u=zuul n=ansible | fatal: [localhost]: FAILED! => { "assertion": "scope_get_response.json is defined", "changed": false, "evaluated_to": false, "msg": "FAILED: Created scope 'fvt_scope_api_test' not found in Scope API GET response." } 2026-03-18 14:47:41,233 p=37285 u=zuul n=ansible | ...ignoring 2026-03-18 14:47:41,241 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : POST to Scope API without last_processed_timestamp] *** 2026-03-18 14:47:41,242 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:41 +0000 (0:00:00.030) 0:00:36.885 ******* 2026-03-18 14:47:41,593 p=37285 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": false, "content": "", "elapsed": 0, "msg": "Status code was -1 and not [400]: Request failed: ", "redirected": false, "status": -1, "url": "https://cloudkitty-internal.openstack.svc:8889/v2/scope"} 2026-03-18 14:47:41,593 p=37285 u=zuul n=ansible | ...ignoring 2026-03-18 14:47:41,600 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : TEST RHOSO Verify CloudKitty Scope API POST rejects request without last_processed_timestamp (OSPRH-23754)] *** 2026-03-18 14:47:41,601 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:41 +0000 (0:00:00.358) 0:00:37.244 ******* 2026-03-18 14:47:41,614 p=37285 u=zuul n=ansible | fatal: [localhost]: FAILED! => { "assertion": "scope_create_no_ts.status == 400", "changed": false, "evaluated_to": false, "msg": "FAILED: CloudKitty Scope API POST should return 400 when last_processed_timestamp is missing." } 2026-03-18 14:47:41,615 p=37285 u=zuul n=ansible | ...ignoring 2026-03-18 14:47:41,621 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Generate Synthetic Data] ************************** 2026-03-18 14:47:41,621 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:41 +0000 (0:00:00.020) 0:00:37.265 ******* 2026-03-18 14:47:41,642 p=37285 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_chargeback/tasks/gen_synth_loki_data.yml for localhost 2026-03-18 14:47:41,654 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Check for preexisting output file] **************** 2026-03-18 14:47:41,654 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:41 +0000 (0:00:00.033) 0:00:37.298 ******* 2026-03-18 14:47:41,989 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:41,997 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Generate Synthetic Data] ********************* 2026-03-18 14:47:41,997 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:41 +0000 (0:00:00.342) 0:00:37.641 ******* 2026-03-18 14:47:42,348 p=37285 u=zuul n=ansible | changed: [localhost] 2026-03-18 14:47:42,354 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Read the content of the file] ********************* 2026-03-18 14:47:42,354 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:42 +0000 (0:00:00.356) 0:00:37.998 ******* 2026-03-18 14:47:42,679 p=37285 u=zuul n=ansible | ok: [localhost] 2026-03-18 14:47:42,687 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : TEST Validate JSON format of synthetic data file] *** 2026-03-18 14:47:42,687 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:42 +0000 (0:00:00.332) 0:00:38.331 ******* 2026-03-18 14:47:42,706 p=37285 u=zuul n=ansible | ok: [localhost] => { "changed": false, "msg": "JSON format validated successfully." } 2026-03-18 14:47:42,713 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Print output_file_remote path] ******************** 2026-03-18 14:47:42,713 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:42 +0000 (0:00:00.026) 0:00:38.357 ******* 2026-03-18 14:47:42,731 p=37285 u=zuul n=ansible | ok: [localhost] => { "msg": "Synthetic data file: /home/zuul/ci-framework-data/logs/gen_loki_synth_data.log" } 2026-03-18 14:47:42,744 p=37285 u=zuul n=ansible | TASK [telemetry_chargeback : Copy output file to remote host] ****************** 2026-03-18 14:47:42,745 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:42 +0000 (0:00:00.031) 0:00:38.388 ******* 2026-03-18 14:47:43,208 p=37285 u=zuul n=ansible | changed: [localhost] 2026-03-18 14:47:43,256 p=37285 u=zuul n=ansible | PLAY RECAP ********************************************************************* 2026-03-18 14:47:43,256 p=37285 u=zuul n=ansible | localhost : ok=109 changed=4 unreachable=0 failed=0 skipped=7 rescued=0 ignored=6 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | Wednesday 18 March 2026 14:47:43 +0000 (0:00:00.522) 0:00:38.910 ******* 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | =============================================================================== 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | telemetry_chargeback : Enable Cloudkitty Module (hashmap) --------------- 3.74s 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | telemetry_chargeback : Change priority for CloudKitty hashmap module ---- 3.06s 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | telemetry_chargeback : Get OpenStack auth token ------------------------- 2.84s 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | telemetry_chargeback : Find the current value of hashmap ---------------- 2.61s 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | common : Verify endpoint "['cloudkitty', 'rating', 'public']" ----------- 2.38s 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | common : Verify endpoint "['cloudkitty', 'rating', 'internal']" --------- 2.34s 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | telemetry_chargeback : Get CloudKitty rating endpoint ------------------- 2.26s 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | telemetry_chargeback : Get status of all CloudKitty rating modules ------ 2.18s 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 0.96s 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | telemetry_chargeback : Copy output file to remote host ------------------ 0.52s 2026-03-18 14:47:43,267 p=37285 u=zuul n=ansible | telemetry_chargeback : Create a scope via the Scope API POST ------------ 0.51s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.46s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.45s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.40s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.40s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.40s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-compactor pod is Running in openstack namespace --- 0.39s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-internal" ------------------------- 0.39s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.38s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.38s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-querier pod is Running in openstack namespace --- 0.37s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | telemetry_chargeback : Retrieve scope via Scope API GET to confirm persistence --- 0.37s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-distributor pod is Running in openstack namespace --- 0.37s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : TEST Check cloudkitty-proc pod is Running in openstack namespace --- 0.37s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-ingester-grpc" ---------- 0.36s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-query-frontend-grpc" ---- 0.36s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-distributor-http" ------- 0.36s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.36s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | telemetry_chargeback : POST to Scope API without last_processed_timestamp --- 0.36s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | telemetry_chargeback : TEST Generate Synthetic Data --------------------- 0.36s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Get the openstack-operators project ---------------------------- 0.36s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-gossip-ring" ------------ 0.35s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : TEST Check cloudkitty-api pod is Running in openstack namespace --- 0.35s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-compactor-grpc" --------- 0.35s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Get the openstack project -------------------------------------- 0.35s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-query-frontend-http" ---- 0.34s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-index-gateway-http" ----- 0.34s 2026-03-18 14:47:43,268 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-distributor-grpc" ------- 0.34s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | telemetry_chargeback : Check for preexisting output file ---------------- 0.34s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-ingester pod is Running in openstack namespace --- 0.34s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-public" --------------------------- 0.34s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-gateway-http" ----------- 0.33s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | telemetry_chargeback : Read the content of the file --------------------- 0.33s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-compactor-http" --------- 0.33s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-querier-grpc" ----------- 0.33s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-query-frontend pod is Running in openstack namespace --- 0.33s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-index-gateway-grpc" ----- 0.33s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-ingester-http" ---------- 0.33s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Verify Service - "cloudkitty-lokistack-querier-http" ----------- 0.32s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : TEST Check cloudkitty-lokistack-index-gateway pod is Running in openstack namespace --- 0.32s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.15s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.10s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.07s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.06s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | telemetry_chargeback : Validate CloudKitty Scope API (OSPRH-23754) ------ 0.04s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | telemetry_chargeback : TEST Validate CloudKitty module states ----------- 0.04s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | telemetry_chargeback : TEST Set priority for CloudKitty hashmap module --- 0.04s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.03s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : TEST Check that cloudkitty internal endpoint exists ----------- 0.03s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | telemetry_chargeback : Generate Synthetic Data -------------------------- 0.03s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | telemetry_chargeback : Print output_file_remote path -------------------- 0.03s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | telemetry_chargeback : TEST RHOSO Verify CloudKitty Scope API GET returns the created scope (OSPRH-23754) --- 0.03s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-index-gateway-grpc service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,269 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-gateway-http service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-querier-http service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-compactor-http service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-distributor-http service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-distributor-grpc service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Check that cloudkitty public endpoint exists ------------- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-querier-grpc service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-index-gateway-http service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | telemetry_chargeback : Validate Chargeback Feature ---------------------- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-compactor-grpc service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | telemetry_chargeback : TEST Validate JSON format of synthetic data file --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-ingester-grpc service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-query-frontend-http service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-internal service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-query-frontend-grpc service is running in openstack namespace --- 0.03s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-public service is running in openstack namespace --- 0.02s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-gossip-ring service is running in openstack namespace --- 0.02s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify openstack project exists -------------------------- 0.02s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify cloudkitty-lokistack-ingester-http service is running in openstack namespace --- 0.02s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-18 14:47:43,270 p=37285 u=zuul n=ansible | common : TEST Verify openstack-operators project exists ---------------- 0.02s 2026-03-18 14:47:43,271 p=37285 u=zuul n=ansible | telemetry_chargeback : TEST RHOSO Verify CloudKitty Scope API POST creates a scope (OSPRH-23754) --- 0.02s 2026-03-18 14:47:43,271 p=37285 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-18 14:47:43,271 p=37285 u=zuul n=ansible | telemetry_chargeback : Display CloudKitty endpoint ---------------------- 0.02s