PLAY [Prepare] *****************************************************************

TASK [Gathering Facts] *********************************************************
Wednesday 10 December 2025  15:03:03 +0000 (0:00:00.012)       0:00:00.012 ****
ok: [instance]

TASK [test_deps : Gather facts if they don't exist] ****************************
Wednesday 10 December 2025  15:03:04 +0000 (0:00:00.821)       0:00:00.833 ****
skipping: [instance]

TASK [test_deps : Gather variables for each operating system] ******************
Wednesday 10 December 2025  15:03:04 +0000 (0:00:00.017)       0:00:00.851 ****
ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)

TASK [test_deps : Detect mirrors file] *****************************************
Wednesday 10 December 2025  15:03:04 +0000 (0:00:00.039)       0:00:00.890 ****
ok: [instance]

TASK [test_deps : Disable ubi host subscription-manager integration] ***********
Wednesday 10 December 2025  15:03:05 +0000 (0:00:00.277)       0:00:01.168 ****
ok: [instance]

TASK [test_deps : Disable ubi 9 repos] *****************************************
Wednesday 10 December 2025  15:03:05 +0000 (0:00:00.299)       0:00:01.467 ****
ok: [instance] => (item=ubi-9-appstream)
ok: [instance] => (item=ubi-9-baseos)
ok: [instance] => (item=ubi-9-codeready-builder)

TASK [Deploy repo-setup] *******************************************************
Wednesday 10 December 2025  15:03:06 +0000 (0:00:00.657)       0:00:02.124 ****

TASK [repo_setup : Ensure directories are present] *****************************
Wednesday 10 December 2025  15:03:06 +0000 (0:00:00.057)       0:00:02.182 ****
changed: [instance] => (item=tmp)
changed: [instance] => (item=artifacts/repositories)
changed: [instance] => (item=venv/repo_setup)

TASK [repo_setup : Make sure git-core package is installed] ********************
Wednesday 10 December 2025  15:03:06 +0000 (0:00:00.514)       0:00:02.697 ****
ok: [instance]

TASK [repo_setup : Get repo-setup repository] **********************************
Wednesday 10 December 2025  15:03:07 +0000 (0:00:00.776)       0:00:03.473 ****
changed: [instance]

TASK [repo_setup : Initialize python venv and install requirements] ************
Wednesday 10 December 2025  15:03:08 +0000 (0:00:01.112)       0:00:04.586 ****
changed: [instance]

TASK [repo_setup : Install repo-setup package] *********************************
Wednesday 10 December 2025  15:03:16 +0000 (0:00:07.752)       0:00:12.339 ****
changed: [instance]

TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
Wednesday 10 December 2025  15:03:17 +0000 (0:00:00.717)       0:00:13.056 ****
skipping: [instance]

TASK [repo_setup : Run repo-setup] *********************************************
Wednesday 10 December 2025  15:03:17 +0000 (0:00:00.019)       0:00:13.076 ****
changed: [instance]

TASK [repo_setup : Get component repo] *****************************************
Wednesday 10 December 2025  15:03:17 +0000 (0:00:00.780)       0:00:13.857 ****
skipping: [instance]

TASK [repo_setup : Rename component repo] **************************************
Wednesday 10 December 2025  15:03:17 +0000 (0:00:00.034)       0:00:13.891 ****
skipping: [instance]

TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
Wednesday 10 December 2025  15:03:17 +0000 (0:00:00.033)       0:00:13.924 ****
skipping: [instance]

TASK [repo_setup : Run repo-setup-get-hash] ************************************
Wednesday 10 December 2025  15:03:17 +0000 (0:00:00.035)       0:00:13.960 ****
changed: [instance]

TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
Wednesday 10 December 2025  15:03:18 +0000 (0:00:00.547)       0:00:14.508 ****
changed: [instance]

TASK [repo_setup : Dump current-podified hash] *********************************
Wednesday 10 December 2025  15:03:18 +0000 (0:00:00.431)       0:00:14.939 ****
skipping: [instance]

TASK [repo_setup : Slurp current podified hash] ********************************
Wednesday 10 December 2025  15:03:18 +0000 (0:00:00.027)       0:00:14.967 ****
skipping: [instance]

TASK [repo_setup : Update the value of full_hash] ******************************
Wednesday 10 December 2025  15:03:18 +0000 (0:00:00.027)       0:00:14.994 ****
skipping: [instance]

TASK [repo_setup : Export hashes facts for further use] ************************
Wednesday 10 December 2025  15:03:18 +0000 (0:00:00.027)       0:00:15.022 ****
ok: [instance]

TASK [repo_setup : Create download directory] **********************************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.036)       0:00:15.058 ****
skipping: [instance]

TASK [repo_setup : Print the URL to request] ***********************************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.025)       0:00:15.083 ****
skipping: [instance]

TASK [Download the RPM] ********************************************************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.025)       0:00:15.109 ****
skipping: [instance]

TASK [repo_setup : Install RHOS Release tool] **********************************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.026)       0:00:15.135 ****
skipping: [instance]

TASK [repo_setup : Get rhos-release tool version] ******************************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.053)       0:00:15.189 ****
skipping: [instance]

TASK [repo_setup : Print rhos-release tool version] ****************************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.026)       0:00:15.215 ****
skipping: [instance]

TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.027)       0:00:15.242 ****
skipping: [instance]

TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.024)       0:00:15.267 ****
ok: [instance]

TASK [repo_setup : Use RDO proxy mirrors] **************************************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.179)       0:00:15.447 ****
changed: [instance]

TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.202)       0:00:15.649 ****
changed: [instance]

TASK [repo_setup : Check for gating.repo file on content provider] *************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.218)       0:00:15.867 ****
skipping: [instance]

TASK [repo_setup : Populate gating repo from content provider ip] **************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.020)       0:00:15.887 ****
skipping: [instance]

TASK [repo_setup : Check for DLRN repo at the destination] *********************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.020)       0:00:15.908 ****
skipping: [instance]

TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.020)       0:00:15.929 ****
skipping: [instance]

TASK [repo_setup : Check for DLRN component repo] ******************************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.021)       0:00:15.950 ****
skipping: [instance]

TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] ***
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.020)       0:00:15.970 ****
skipping: [instance]

TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.020)       0:00:15.991 ****
skipping: [instance]

TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.015)       0:00:16.007 ****
skipping: [instance]

TASK [repo_setup : Cleanup existing metadata] **********************************
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.028)       0:00:16.035 ****
skipping: [instance]

TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
Wednesday 10 December 2025  15:03:19 +0000 (0:00:00.017)       0:00:16.053 ****
skipping: [instance]

TASK [test_deps : Look for redhat-release rpm] *********************************
Wednesday 10 December 2025  15:03:20 +0000 (0:00:00.023)       0:00:16.076 ****
skipping: [instance]

TASK [test_deps : Remove redhat-release] ***************************************
Wednesday 10 December 2025  15:03:20 +0000 (0:00:00.029)       0:00:16.105 ****
skipping: [instance]

TASK [test_deps : Install centos-stream-release] *******************************
Wednesday 10 December 2025  15:03:20 +0000 (0:00:00.028)       0:00:16.134 ****
skipping: [instance]

TASK [test_deps : Install additional packages] *********************************
Wednesday 10 December 2025  15:03:20 +0000 (0:00:00.029)       0:00:16.163 ****
skipping: [instance]

TASK [test_deps : Install selinux python libs] *********************************
Wednesday 10 December 2025  15:03:20 +0000 (0:00:00.028)       0:00:16.192 ****
ok: [instance]

TASK [test_deps : Install python yaml libs] ************************************
Wednesday 10 December 2025  15:04:04 +0000 (0:00:44.444)       0:01:00.636 ****
ok: [instance]

TASK [test_deps : Install extra packages] **************************************
Wednesday 10 December 2025  15:04:05 +0000 (0:00:01.117)       0:01:01.754 ****
skipping: [instance]

TASK [Ensure cifmw_ceph_client_config_home exists on all clients] **************
Wednesday 10 December 2025  15:04:05 +0000 (0:00:00.036)       0:01:01.791 ****
changed: [instance]

PLAY RECAP *********************************************************************
instance                   : ok=20   changed=10   unreachable=0    failed=0    skipped=30   rescued=0    ignored=0

Wednesday 10 December 2025  15:04:05 +0000 (0:00:00.212)       0:01:02.003 ****
===============================================================================
test_deps : Install selinux python libs -------------------------------- 44.44s
repo_setup : Initialize python venv and install requirements ------------ 7.75s
test_deps : Install python yaml libs ------------------------------------ 1.12s
repo_setup : Get repo-setup repository ---------------------------------- 1.11s
Gathering Facts --------------------------------------------------------- 0.82s
repo_setup : Run repo-setup --------------------------------------------- 0.78s
repo_setup : Make sure git-core package is installed -------------------- 0.78s
repo_setup : Install repo-setup package --------------------------------- 0.72s
test_deps : Disable ubi 9 repos ----------------------------------------- 0.66s
repo_setup : Run repo-setup-get-hash ------------------------------------ 0.55s
repo_setup : Ensure directories are present ----------------------------- 0.51s
repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s
test_deps : Disable ubi host subscription-manager integration ----------- 0.30s
test_deps : Detect mirrors file ----------------------------------------- 0.28s
repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist) --- 0.22s
Ensure cifmw_ceph_client_config_home exists on all clients -------------- 0.21s
repo_setup : Use RDO proxy mirrors -------------------------------------- 0.20s
repo_setup : Check for /etc/ci/mirror_info.sh --------------------------- 0.18s
Deploy repo-setup ------------------------------------------------------- 0.06s
repo_setup : Install RHOS Release tool ---------------------------------- 0.05s

PLAY [Converge] ****************************************************************

TASK [Gathering Facts] *********************************************************
Wednesday 10 December 2025  15:04:06 +0000 (0:00:00.014)       0:00:00.014 ****
ok: [instance]

TASK [cifmw_ceph_client : Check if the input variables exist] ******************
Wednesday 10 December 2025  15:04:07 +0000 (0:00:00.750)       0:00:00.764 ****
skipping: [instance]

TASK [cifmw_ceph_client : Load variables produced by the cephadm provisioning process] ***
Wednesday 10 December 2025  15:04:07 +0000 (0:00:00.021)       0:00:00.786 ****
skipping: [instance]

TASK [cifmw_ceph_client : Render keys provided for the Ceph cluster] ***********
Wednesday 10 December 2025  15:04:07 +0000 (0:00:00.019)       0:00:00.806 ****
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_ceph_client/tasks/create_keys.yml for instance

TASK [cifmw_ceph_client : Create cephx key(s)] *********************************
Wednesday 10 December 2025  15:04:07 +0000 (0:00:00.026)       0:00:00.832 ****
changed: [instance] => (item={'caps': {'mgr': 'allow *', 'mon': 'profile rbd', 'osd': 'profile rbd pool=vms, profile rbd pool=volumes, profile rbd pool=metrics, profile rbd pool=backups, profile rbd pool=pool2, profile rbd pool=pool3, profile rbd pool=altrbd'}, 'key': 'AQC+vYNXgDAgAhAAc8UoYt+OTz5uhV7ItLdwUw==', 'mode': '0600', 'name': 'client.glance'})
changed: [instance] => (item={'caps': {'mgr': 'allow *', 'mon': 'profile rbd', 'osd': 'profile rbd pool=images'}, 'key': 'AQBRgQ9eAAAAABAAv84zEilJYZPNuJ0Iwn9Ndg==', 'mode': '0600', 'name': 'client.manila'})

TASK [cifmw_ceph_client : Render ceph config for the Ceph Clients] *************
Wednesday 10 December 2025  15:04:08 +0000 (0:00:00.837)       0:00:01.670 ****
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_ceph_client/tasks/create_ceph_conf.yml for instance

TASK [cifmw_ceph_client : Create ceph.conf] ************************************
Wednesday 10 December 2025  15:04:08 +0000 (0:00:00.020)       0:00:01.690 ****
changed: [instance]

TASK [cifmw_ceph_client : Import glance Ceph RGW discovery playbook] ***********
Wednesday 10 December 2025  15:04:08 +0000 (0:00:00.371)       0:00:02.062 ****
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_ceph_client/tasks/glance-rgw-discovery.yaml for instance

TASK [cifmw_ceph_client : Set fact for glance S3 backend secrets] **************
Wednesday 10 December 2025  15:04:08 +0000 (0:00:00.023)       0:00:02.085 ****
skipping: [instance]

TASK [cifmw_ceph_client : Generate Glance S3 backend secrets using Ceph RGW credentials] ***
Wednesday 10 December 2025  15:04:08 +0000 (0:00:00.021)       0:00:02.106 ****
skipping: [instance]

TASK [cifmw_ceph_client : Create glance S3 backend secrets] ********************
Wednesday 10 December 2025  15:04:08 +0000 (0:00:00.024)       0:00:02.131 ****
skipping: [instance]

TASK [cifmw_ceph_client : Delete the rendered secret file] *********************
Wednesday 10 December 2025  15:04:08 +0000 (0:00:00.021)       0:00:02.153 ****
ok: [instance -> localhost]

TASK [cifmw_ceph_client : Create edpm-values-post-ceph ConfigMap if sample path provided] ***
Wednesday 10 December 2025  15:04:08 +0000 (0:00:00.277)       0:00:02.430 ****
skipping: [instance]

TASK [cifmw_ceph_client : Create edpm-service-values-post-ceph ConfigMap if sample path provided] ***
Wednesday 10 December 2025  15:04:08 +0000 (0:00:00.021)       0:00:02.451 ****
skipping: [instance]

TASK [Check current file] ******************************************************
Wednesday 10 December 2025  15:04:08 +0000 (0:00:00.024)       0:00:02.475 ****
ok: [instance] => (item=ceph.client.glance.keyring)
ok: [instance] => (item=ceph.client.manila.keyring)
ok: [instance] => (item=ceph.conf)

TASK [Fail if file not found] **************************************************
Wednesday 10 December 2025  15:04:09 +0000 (0:00:00.522)       0:00:02.998 ****
skipping: [instance] => (item={'changed': False, 'stat': {'exists': True, 'path': '/tmp/ceph.client.glance.keyring', 'mode': '0600', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 1000, 'gid': 1000, 'size': 302, 'inode': 104874811, 'dev': 64513, 'nlink': 1, 'atime': 1765379047.7221162, 'mtime': 1765379047.4851148, 'ctime': 1765379047.7241163, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': False, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 8, 'block_size': 4096, 'device_type': 0, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'zuul', 'gr_name': 'zuul', 'checksum': 'e7164142ee2f357bf32771e16ce9bcaf223d404e', 'mimetype': 'text/plain', 'charset': 'us-ascii', 'version': '3089393310', 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/tmp/ceph.client.glance.keyring', 'follow': False, 'get_md5': False, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': 'ceph.client.glance.keyring', 'ansible_loop_var': 'item'})
skipping: [instance] => (item={'changed': False, 'stat': {'exists': True, 'path': '/tmp/ceph.client.manila.keyring', 'mode': '0600', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 1000, 'gid': 1000, 'size': 154, 'inode': 121641409, 'dev': 64513, 'nlink': 1, 'atime': 1765379048.0301185, 'mtime': 1765379047.8931174, 'ctime': 1765379048.0321183, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': False, 'xgrp': False, 'woth': False, 'roth': False, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 8, 'block_size': 4096, 'device_type': 0, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'zuul', 'gr_name': 'zuul', 'checksum': 'd6d4783ea1936e82934ab1c7b21cc940553e7bd8', 'mimetype': 'text/plain', 'charset': 'us-ascii', 'version': '4041427947', 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/tmp/ceph.client.manila.keyring', 'follow': False, 'get_md5': False, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': 'ceph.client.manila.keyring', 'ansible_loop_var': 'item'})
skipping: [instance] => (item={'changed': False, 'stat': {'exists': True, 'path': '/tmp/ceph.conf', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 386, 'inode': 138463693, 'dev': 64513, 'nlink': 1, 'atime': 1765379048.422121, 'mtime': 1765379048.27812, 'ctime': 1765379048.425121, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 8, 'block_size': 4096, 'device_type': 0, 'readable': True, 'writeable': False, 'executable': False, 'pw_name': 'root', 'gr_name': 'root', 'checksum': 'e31ff745c34475be37b341f51eb9c14b9adbb4f9', 'mimetype': 'text/plain', 'charset': 'us-ascii', 'version': '270967160', 'attributes': [], 'attr_flags': ''}, 'invocation': {'module_args': {'path': '/tmp/ceph.conf', 'follow': False, 'get_md5': False, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': 'ceph.conf', 'ansible_loop_var': 'item'})
skipping: [instance]

TASK [Show the content of the generated Ceph config file] **********************
Wednesday 10 December 2025  15:04:09 +0000 (0:00:00.028)       0:00:03.027 ****
ok: [instance]

TASK [Debug ceph config] *******************************************************
Wednesday 10 December 2025  15:04:09 +0000 (0:00:00.271)       0:00:03.298 ****
ok: [instance] =>
  msg: |-
    # Ansible managed: Do NOT edit this file manually!

    [global]

    fsid = 1dee28aa-2eba-11eb-b30b-244200b898e6
    mon host = 172.16.3.10,172.16.3.11,172.16.3.12
    [client]
    rbd_cache = True
    rbd_cache_writethrough_until_flush = True
    rbd_concurrent_management_ops = 20


    [client.libvirt]
    admin socket = /var/run/ceph/$cluster-$type.$id.$pid.$cctid.asok
    log file = /var/log/ceph/qemu-guest-$pid.log

PLAY RECAP *********************************************************************
instance                   : ok=10   changed=2    unreachable=0    failed=0    skipped=8    rescued=0    ignored=0

Wednesday 10 December 2025  15:04:09 +0000 (0:00:00.039)       0:00:03.338 ****
===============================================================================
cifmw_ceph_client : Create cephx key(s) --------------------------------- 0.84s
Gathering Facts --------------------------------------------------------- 0.75s
Check current file ------------------------------------------------------ 0.52s
cifmw_ceph_client : Create ceph.conf ------------------------------------ 0.37s
cifmw_ceph_client : Delete the rendered secret file --------------------- 0.28s
Show the content of the generated Ceph config file ---------------------- 0.27s
Debug ceph config ------------------------------------------------------- 0.04s
Fail if file not found -------------------------------------------------- 0.03s
cifmw_ceph_client : Render keys provided for the Ceph cluster ----------- 0.03s
cifmw_ceph_client : Generate Glance S3 backend secrets using Ceph RGW credentials --- 0.02s
cifmw_ceph_client : Create edpm-service-values-post-ceph ConfigMap if sample path provided --- 0.02s
cifmw_ceph_client : Import glance Ceph RGW discovery playbook ----------- 0.02s
cifmw_ceph_client : Create glance S3 backend secrets -------------------- 0.02s
cifmw_ceph_client : Check if the input variables exist ------------------ 0.02s
cifmw_ceph_client : Set fact for glance S3 backend secrets -------------- 0.02s
cifmw_ceph_client : Create edpm-values-post-ceph ConfigMap if sample path provided --- 0.02s
cifmw_ceph_client : Render ceph config for the Ceph Clients ------------- 0.02s
cifmw_ceph_client : Load variables produced by the cephadm provisioning process --- 0.02s