PLAY [Prepare] ***************************************************************** TASK [Gathering Facts] ********************************************************* Thursday 27 November 2025 09:41:40 +0000 (0:00:00.018) 0:00:00.018 ***** ok: [instance] TASK [Create custom basedir] *************************************************** Thursday 27 November 2025 09:41:41 +0000 (0:00:00.818) 0:00:00.836 ***** changed: [instance] TASK [test_deps : Gather facts if they don't exist] **************************** Thursday 27 November 2025 09:41:41 +0000 (0:00:00.300) 0:00:01.137 ***** skipping: [instance] TASK [test_deps : Gather variables for each operating system] ****************** Thursday 27 November 2025 09:41:41 +0000 (0:00:00.018) 0:00:01.155 ***** ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) TASK [test_deps : Detect mirrors file] ***************************************** Thursday 27 November 2025 09:41:41 +0000 (0:00:00.040) 0:00:01.196 ***** ok: [instance] TASK [test_deps : Disable ubi host subscription-manager integration] *********** Thursday 27 November 2025 09:41:41 +0000 (0:00:00.298) 0:00:01.494 ***** ok: [instance] TASK [test_deps : Disable ubi 9 repos] ***************************************** Thursday 27 November 2025 09:41:42 +0000 (0:00:00.204) 0:00:01.699 ***** ok: [instance] => (item=ubi-9-appstream) ok: [instance] => (item=ubi-9-baseos) ok: [instance] => (item=ubi-9-codeready-builder) TASK [Deploy repo-setup] ******************************************************* Thursday 27 November 2025 09:41:42 +0000 (0:00:00.656) 0:00:02.355 ***** TASK [repo_setup : Ensure directories are present] ***************************** Thursday 27 November 2025 09:41:42 +0000 (0:00:00.056) 0:00:02.411 ***** changed: [instance] => (item=tmp) changed: [instance] => (item=artifacts/repositories) changed: [instance] => (item=venv/repo_setup) TASK [repo_setup : Make sure git-core package is installed] ******************** Thursday 27 November 2025 09:41:43 +0000 (0:00:00.526) 0:00:02.938 ***** ok: [instance] TASK [repo_setup : Get repo-setup repository] ********************************** Thursday 27 November 2025 09:41:44 +0000 (0:00:00.766) 0:00:03.704 ***** changed: [instance] TASK [repo_setup : Initialize python venv and install requirements] ************ Thursday 27 November 2025 09:41:45 +0000 (0:00:01.052) 0:00:04.756 ***** changed: [instance] TASK [repo_setup : Install repo-setup package] ********************************* Thursday 27 November 2025 09:41:52 +0000 (0:00:07.495) 0:00:12.252 ***** changed: [instance] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Thursday 27 November 2025 09:41:53 +0000 (0:00:00.685) 0:00:12.938 ***** skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Thursday 27 November 2025 09:41:53 +0000 (0:00:00.021) 0:00:12.959 ***** changed: [instance] TASK [repo_setup : Get component repo] ***************************************** Thursday 27 November 2025 09:41:54 +0000 (0:00:00.772) 0:00:13.732 ***** skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Thursday 27 November 2025 09:41:54 +0000 (0:00:00.035) 0:00:13.768 ***** skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Thursday 27 November 2025 09:41:54 +0000 (0:00:00.033) 0:00:13.802 ***** skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Thursday 27 November 2025 09:41:54 +0000 (0:00:00.034) 0:00:13.836 ***** changed: [instance] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Thursday 27 November 2025 09:41:54 +0000 (0:00:00.514) 0:00:14.351 ***** changed: [instance] TASK [repo_setup : Dump current-podified hash] ********************************* Thursday 27 November 2025 09:41:55 +0000 (0:00:00.422) 0:00:14.773 ***** skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.028) 0:00:14.801 ***** skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.027) 0:00:14.829 ***** skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Thursday 27 November 2025 09:41:55 +0000 (0:00:00.028) 0:00:14.857 ***** ok: [instance] TASK [repo_setup : Create download directory] ********************************** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.034) 0:00:14.892 ***** skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.026) 0:00:14.919 ***** skipping: [instance] TASK [Download the RPM] ******************************************************** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.027) 0:00:14.946 ***** skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.026) 0:00:14.973 ***** skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.025) 0:00:14.998 ***** skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.025) 0:00:15.023 ***** skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.027) 0:00:15.050 ***** skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.025) 0:00:15.076 ***** ok: [instance] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.177) 0:00:15.253 ***** changed: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Thursday 27 November 2025 09:41:55 +0000 (0:00:00.215) 0:00:15.468 ***** changed: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Thursday 27 November 2025 09:41:56 +0000 (0:00:00.219) 0:00:15.688 ***** skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Thursday 27 November 2025 09:41:56 +0000 (0:00:00.022) 0:00:15.711 ***** skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Thursday 27 November 2025 09:41:56 +0000 (0:00:00.022) 0:00:15.734 ***** skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Thursday 27 November 2025 09:41:56 +0000 (0:00:00.021) 0:00:15.755 ***** skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Thursday 27 November 2025 09:41:56 +0000 (0:00:00.022) 0:00:15.777 ***** skipping: [instance] TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** Thursday 27 November 2025 09:41:56 +0000 (0:00:00.022) 0:00:15.800 ***** skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Thursday 27 November 2025 09:41:56 +0000 (0:00:00.020) 0:00:15.820 ***** skipping: [instance] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Thursday 27 November 2025 09:41:56 +0000 (0:00:00.015) 0:00:15.836 ***** skipping: [instance] TASK [repo_setup : Cleanup existing metadata] ********************************** Thursday 27 November 2025 09:41:56 +0000 (0:00:00.029) 0:00:15.865 ***** skipping: [instance] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Thursday 27 November 2025 09:41:56 +0000 (0:00:00.016) 0:00:15.882 ***** skipping: [instance] TASK [test_deps : Look for redhat-release rpm] ********************************* Thursday 27 November 2025 09:41:56 +0000 (0:00:00.017) 0:00:15.899 ***** skipping: [instance] TASK [test_deps : Remove redhat-release] *************************************** Thursday 27 November 2025 09:41:56 +0000 (0:00:00.026) 0:00:15.925 ***** skipping: [instance] TASK [test_deps : Install centos-stream-release] ******************************* Thursday 27 November 2025 09:41:56 +0000 (0:00:00.027) 0:00:15.953 ***** skipping: [instance] TASK [test_deps : Install additional packages] ********************************* Thursday 27 November 2025 09:41:56 +0000 (0:00:00.027) 0:00:15.980 ***** skipping: [instance] TASK [test_deps : Install selinux python libs] ********************************* Thursday 27 November 2025 09:41:56 +0000 (0:00:00.025) 0:00:16.006 ***** ok: [instance] TASK [test_deps : Install python yaml libs] ************************************ Thursday 27 November 2025 09:42:37 +0000 (0:00:41.026) 0:00:57.033 ***** ok: [instance] TASK [test_deps : Install extra packages] ************************************** Thursday 27 November 2025 09:42:38 +0000 (0:00:01.204) 0:00:58.238 ***** skipping: [instance] TASK [ci_setup : Gather variables for each operating system] ******************* Thursday 27 November 2025 09:42:38 +0000 (0:00:00.032) 0:00:58.271 ***** ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) TASK [ci_setup : List packages to install] ************************************* Thursday 27 November 2025 09:42:38 +0000 (0:00:00.040) 0:00:58.312 ***** ok: [instance] => cifmw_ci_setup_packages: - bash-completion - ca-certificates - git-core - make - tar - tmux - python3-pip TASK [ci_setup : Install needed packages] ************************************** Thursday 27 November 2025 09:42:38 +0000 (0:00:00.020) 0:00:58.333 ***** changed: [instance] TASK [ci_setup : Gather version of openshift client] *************************** Thursday 27 November 2025 09:42:42 +0000 (0:00:03.747) 0:01:02.080 ***** ok: [instance] TASK [ci_setup : Ensure openshift client install path is present] ************** Thursday 27 November 2025 09:42:43 +0000 (0:00:00.547) 0:01:02.627 ***** changed: [instance] TASK [ci_setup : Install openshift client] ************************************* Thursday 27 November 2025 09:42:43 +0000 (0:00:00.219) 0:01:02.846 ***** changed: [instance] TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** Thursday 27 November 2025 09:42:49 +0000 (0:00:05.907) 0:01:08.754 ***** ok: [instance] TASK [ci_setup : Create completion file] *************************************** Thursday 27 November 2025 09:42:49 +0000 (0:00:00.045) 0:01:08.800 ***** changed: [instance] TASK [ci_setup : Source completion from within .bashrc] ************************ Thursday 27 November 2025 09:42:49 +0000 (0:00:00.268) 0:01:09.068 ***** changed: [instance] TASK [ci_setup : Check rhsm status] ******************************************** Thursday 27 November 2025 09:42:49 +0000 (0:00:00.282) 0:01:09.350 ***** skipping: [instance] TASK [ci_setup : Gather the repos to be enabled] ******************************* Thursday 27 November 2025 09:42:49 +0000 (0:00:00.019) 0:01:09.370 ***** skipping: [instance] TASK [ci_setup : Enabling the required repositories.] ************************** Thursday 27 November 2025 09:42:49 +0000 (0:00:00.019) 0:01:09.389 ***** skipping: [instance] TASK [ci_setup : Get current /etc/redhat-release] ****************************** Thursday 27 November 2025 09:42:49 +0000 (0:00:00.019) 0:01:09.409 ***** skipping: [instance] TASK [ci_setup : Print current /etc/redhat-release] **************************** Thursday 27 November 2025 09:42:49 +0000 (0:00:00.017) 0:01:09.427 ***** skipping: [instance] TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* Thursday 27 November 2025 09:42:49 +0000 (0:00:00.017) 0:01:09.444 ***** skipping: [instance] TASK [ci_setup : Manage directories] ******************************************* Thursday 27 November 2025 09:42:49 +0000 (0:00:00.022) 0:01:09.466 ***** changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) changed: [instance] => (item=/opt/basedir/logs) ok: [instance] => (item=/opt/basedir/tmp) changed: [instance] => (item=/opt/basedir/volumes) changed: [instance] => (item=/opt/basedir/artifacts/parameters) TASK [Create secret file] ****************************************************** Thursday 27 November 2025 09:42:50 +0000 (0:00:00.983) 0:01:10.450 ***** changed: [instance] PLAY RECAP ********************************************************************* instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 Thursday 27 November 2025 09:42:51 +0000 (0:00:00.364) 0:01:10.815 ***** =============================================================================== test_deps : Install selinux python libs -------------------------------- 41.03s repo_setup : Initialize python venv and install requirements ------------ 7.50s ci_setup : Install openshift client ------------------------------------- 5.91s ci_setup : Install needed packages -------------------------------------- 3.75s test_deps : Install python yaml libs ------------------------------------ 1.20s repo_setup : Get repo-setup repository ---------------------------------- 1.05s ci_setup : Manage directories ------------------------------------------- 0.98s Gathering Facts --------------------------------------------------------- 0.82s repo_setup : Run repo-setup --------------------------------------------- 0.77s repo_setup : Make sure git-core package is installed -------------------- 0.77s repo_setup : Install repo-setup package --------------------------------- 0.69s test_deps : Disable ubi 9 repos ----------------------------------------- 0.66s ci_setup : Gather version of openshift client --------------------------- 0.55s repo_setup : Ensure directories are present ----------------------------- 0.53s repo_setup : Run repo-setup-get-hash ------------------------------------ 0.51s repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.42s Create secret file ------------------------------------------------------ 0.36s Create custom basedir --------------------------------------------------- 0.30s test_deps : Detect mirrors file ----------------------------------------- 0.30s ci_setup : Source completion from within .bashrc ------------------------ 0.28s PLAY [Converge] **************************************************************** TASK [Gathering Facts] ********************************************************* Thursday 27 November 2025 09:42:51 +0000 (0:00:00.027) 0:00:00.027 ***** ok: [instance] TASK [Load networking definition from scenario file] *************************** Thursday 27 November 2025 09:42:52 +0000 (0:00:00.828) 0:00:00.855 ***** ok: [instance] TASK [discover_latest_image : Get latest image] ******************************** Thursday 27 November 2025 09:42:52 +0000 (0:00:00.023) 0:00:00.879 ***** changed: [instance] TASK [discover_latest_image : Export facts accordingly] ************************ Thursday 27 November 2025 09:42:54 +0000 (0:00:01.866) 0:00:02.745 ***** ok: [instance] TASK [reproducer : Load CI job environment] ************************************ Thursday 27 November 2025 09:42:54 +0000 (0:00:00.028) 0:00:02.774 ***** skipping: [instance] TASK [Build final libvirt layout] ********************************************** Thursday 27 November 2025 09:42:54 +0000 (0:00:00.023) 0:00:02.797 ***** TASK [libvirt_manager : Chose right parameter for layout definition] *********** Thursday 27 November 2025 09:42:54 +0000 (0:00:00.068) 0:00:02.866 ***** ok: [instance] TASK [libvirt_manager : Patch the layout if needed] **************************** Thursday 27 November 2025 09:42:54 +0000 (0:00:00.079) 0:00:02.945 ***** skipping: [instance] TASK [reproducer : Assert no conflicting parameters were passed] *************** Thursday 27 November 2025 09:42:54 +0000 (0:00:00.062) 0:00:03.008 ***** ok: [instance] TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** Thursday 27 November 2025 09:42:54 +0000 (0:00:00.027) 0:00:03.035 ***** ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Set _use_crc based on actual layout] ************************ Thursday 27 November 2025 09:42:54 +0000 (0:00:00.027) 0:00:03.063 ***** ok: [instance] TASK [reproducer : Ensure directories are present] ***************************** Thursday 27 November 2025 09:42:55 +0000 (0:00:00.042) 0:00:03.105 ***** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [Bootstrap libvirt if needed] ********************************************* Thursday 27 November 2025 09:42:55 +0000 (0:00:00.461) 0:00:03.567 ***** TASK [libvirt_manager : Ensure output directory exists] ************************ Thursday 27 November 2025 09:42:55 +0000 (0:00:00.076) 0:00:03.644 ***** ok: [instance] TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* Thursday 27 November 2025 09:42:55 +0000 (0:00:00.196) 0:00:03.840 ***** changed: [instance] TASK [libvirt_manager : Check if KVM is enabled] ******************************* Thursday 27 November 2025 09:42:56 +0000 (0:00:00.253) 0:00:04.093 ***** ok: [instance] TASK [libvirt_manager : Fail if KVM not enabled] ******************************* Thursday 27 November 2025 09:42:56 +0000 (0:00:00.294) 0:00:04.388 ***** skipping: [instance] TASK [libvirt_manager : Check if VMX virtualization] *************************** Thursday 27 November 2025 09:42:56 +0000 (0:00:00.032) 0:00:04.421 ***** skipping: [instance] TASK [libvirt_manager : Check if SVM virtualization] *************************** Thursday 27 November 2025 09:42:56 +0000 (0:00:00.020) 0:00:04.441 ***** ok: [instance] TASK [libvirt_manager : Enable VMX virtualization] ***************************** Thursday 27 November 2025 09:42:56 +0000 (0:00:00.022) 0:00:04.463 ***** skipping: [instance] TASK [libvirt_manager : Install packages required for using KVM] *************** Thursday 27 November 2025 09:42:56 +0000 (0:00:00.031) 0:00:04.494 ***** changed: [instance] TASK [libvirt_manager : Create rules.d polkit folder] ************************** Thursday 27 November 2025 09:43:08 +0000 (0:00:12.315) 0:00:16.809 ***** changed: [instance] TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* Thursday 27 November 2025 09:43:08 +0000 (0:00:00.237) 0:00:17.047 ***** changed: [instance] TASK [libvirt_manager : Restart service polkit service] ************************ Thursday 27 November 2025 09:43:09 +0000 (0:00:00.531) 0:00:17.578 ***** changed: [instance] TASK [libvirt_manager : Remove directory for service override] ***************** Thursday 27 November 2025 09:43:10 +0000 (0:00:00.655) 0:00:18.234 ***** ok: [instance] TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** Thursday 27 November 2025 09:43:10 +0000 (0:00:00.201) 0:00:18.436 ***** ok: [instance] TASK [libvirt_manager : Ensure firewalld service is up] ************************ Thursday 27 November 2025 09:43:11 +0000 (0:00:00.676) 0:00:19.112 ***** changed: [instance] TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** Thursday 27 November 2025 09:43:11 +0000 (0:00:00.917) 0:00:20.030 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* Thursday 27 November 2025 09:43:12 +0000 (0:00:00.091) 0:00:20.121 ***** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** Thursday 27 November 2025 09:43:12 +0000 (0:00:00.343) 0:00:20.465 ***** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** Thursday 27 November 2025 09:43:12 +0000 (0:00:00.334) 0:00:20.799 ***** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** Thursday 27 November 2025 09:43:13 +0000 (0:00:00.345) 0:00:21.144 ***** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** Thursday 27 November 2025 09:43:14 +0000 (0:00:01.337) 0:00:22.482 ***** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* Thursday 27 November 2025 09:43:15 +0000 (0:00:01.342) 0:00:23.824 ***** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** Thursday 27 November 2025 09:43:16 +0000 (0:00:00.339) 0:00:24.164 ***** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* Thursday 27 November 2025 09:43:16 +0000 (0:00:00.339) 0:00:24.503 ***** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** Thursday 27 November 2025 09:43:16 +0000 (0:00:00.337) 0:00:24.841 ***** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** Thursday 27 November 2025 09:43:17 +0000 (0:00:00.342) 0:00:25.183 ***** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* Thursday 27 November 2025 09:43:17 +0000 (0:00:00.353) 0:00:25.536 ***** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** Thursday 27 November 2025 09:43:17 +0000 (0:00:00.355) 0:00:25.892 ***** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** Thursday 27 November 2025 09:43:18 +0000 (0:00:00.332) 0:00:26.225 ***** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** Thursday 27 November 2025 09:43:18 +0000 (0:00:00.332) 0:00:26.557 ***** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** Thursday 27 November 2025 09:43:18 +0000 (0:00:00.327) 0:00:26.885 ***** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* Thursday 27 November 2025 09:43:19 +0000 (0:00:00.334) 0:00:27.219 ***** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** Thursday 27 November 2025 09:43:19 +0000 (0:00:00.331) 0:00:27.551 ***** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ Thursday 27 November 2025 09:43:19 +0000 (0:00:00.332) 0:00:27.884 ***** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** Thursday 27 November 2025 09:43:20 +0000 (0:00:00.333) 0:00:28.218 ***** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* Thursday 27 November 2025 09:43:20 +0000 (0:00:00.345) 0:00:28.563 ***** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** Thursday 27 November 2025 09:43:20 +0000 (0:00:00.335) 0:00:28.899 ***** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** Thursday 27 November 2025 09:43:21 +0000 (0:00:00.320) 0:00:29.219 ***** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* Thursday 27 November 2025 09:43:21 +0000 (0:00:00.318) 0:00:29.537 ***** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* Thursday 27 November 2025 09:43:21 +0000 (0:00:00.317) 0:00:29.855 ***** ok: [instance] TASK [libvirt_manager : Manage service for older releases] ********************* Thursday 27 November 2025 09:43:23 +0000 (0:00:01.336) 0:00:31.191 ***** skipping: [instance] TASK [libvirt_manager : Get libvirt group users] ******************************* Thursday 27 November 2025 09:43:23 +0000 (0:00:00.026) 0:00:31.217 ***** ok: [instance] TASK [libvirt_manager : Add user if not exists in libvirt group] *************** Thursday 27 November 2025 09:43:23 +0000 (0:00:00.288) 0:00:31.506 ***** ok: [instance] TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** Thursday 27 November 2025 09:43:23 +0000 (0:00:00.389) 0:00:31.895 ***** changed: [instance] TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* Thursday 27 November 2025 09:43:24 +0000 (0:00:00.315) 0:00:32.211 ***** [WARNING]: Reset is not implemented for this connection changed: [instance] TASK [libvirt_manager : Ensure we reload user env] ***************************** Thursday 27 November 2025 09:43:24 +0000 (0:00:00.291) 0:00:32.502 ***** TASK [reproducer : Deploy networks in libvirt] ********************************* Thursday 27 November 2025 09:43:24 +0000 (0:00:00.015) 0:00:32.517 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance TASK [reproducer : Ensure networks are consistent] ***************************** Thursday 27 November 2025 09:43:24 +0000 (0:00:00.112) 0:00:32.630 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Thursday 27 November 2025 09:43:24 +0000 (0:00:00.048) 0:00:32.679 ***** ok: [instance] => (item=compute) ok: [instance] => (item=controller) ok: [instance] => (item=crc) TASK [reproducer : Ensure all standard attached networks are defined] ********** Thursday 27 November 2025 09:43:24 +0000 (0:00:00.053) 0:00:32.732 ***** ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Thursday 27 November 2025 09:43:24 +0000 (0:00:00.051) 0:00:32.784 ***** ok: [instance] => changed=false msg: All assertions passed TASK [Ensure we get latest OCP config] ***************************************** Thursday 27 November 2025 09:43:24 +0000 (0:00:00.047) 0:00:32.831 ***** TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** Thursday 27 November 2025 09:43:24 +0000 (0:00:00.046) 0:00:32.878 ***** ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) ok: [instance] => (item={}) TASK [devscripts : Replace OCP version if "stable-" alias used] **************** Thursday 27 November 2025 09:43:24 +0000 (0:00:00.078) 0:00:32.956 ***** skipping: [instance] TASK [devscripts : Ensure output directory exists] ***************************** Thursday 27 November 2025 09:43:24 +0000 (0:00:00.022) 0:00:32.979 ***** ok: [instance] TASK [devscripts : Output built config for easier debugging] ******************* Thursday 27 November 2025 09:43:25 +0000 (0:00:00.221) 0:00:33.200 ***** changed: [instance] TASK [ci_network : Remove the local dns configuration] ************************* Thursday 27 November 2025 09:43:25 +0000 (0:00:00.345) 0:00:33.546 ***** ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) TASK [ci_network : Reload the NetworkManager to pick the changes] ************** Thursday 27 November 2025 09:43:26 +0000 (0:00:00.761) 0:00:34.307 ***** skipping: [instance] TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* Thursday 27 November 2025 09:43:26 +0000 (0:00:00.030) 0:00:34.338 ***** changed: [instance] TASK [reproducer : Flush handlers for NetworkManager restart] ****************** Thursday 27 November 2025 09:43:26 +0000 (0:00:00.384) 0:00:34.722 ***** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Thursday 27 November 2025 09:43:26 +0000 (0:00:00.008) 0:00:34.731 ***** changed: [instance] TASK [Ensure no default networks exists] *************************************** Thursday 27 November 2025 09:43:27 +0000 (0:00:00.461) 0:00:35.192 ***** TASK [libvirt_manager : Deactivate crc] **************************************** Thursday 27 November 2025 09:43:27 +0000 (0:00:00.078) 0:00:35.271 ***** ok: [instance] TASK [libvirt_manager : Removing crc] ****************************************** Thursday 27 November 2025 09:43:28 +0000 (0:00:01.267) 0:00:36.539 ***** ok: [instance] TASK [libvirt_manager : Deactivate default] ************************************ Thursday 27 November 2025 09:43:28 +0000 (0:00:00.240) 0:00:36.780 ***** ok: [instance] TASK [libvirt_manager : Removing default] ************************************** Thursday 27 November 2025 09:43:29 +0000 (0:00:00.537) 0:00:37.317 ***** ok: [instance] TASK [reproducer : Ensure firewalld is installed] ****************************** Thursday 27 November 2025 09:43:29 +0000 (0:00:00.245) 0:00:37.563 ***** ok: [instance] TASK [reproducer : Ensure firewalld service is enabled and started] ************ Thursday 27 November 2025 09:43:30 +0000 (0:00:01.254) 0:00:38.817 ***** ok: [instance] TASK [reproducer : Ensure br_netfilter module is loaded] *********************** Thursday 27 November 2025 09:43:31 +0000 (0:00:00.322) 0:00:39.139 ***** changed: [instance] TASK [reproducer : Ensure IP forwarding is enabled] **************************** Thursday 27 November 2025 09:43:31 +0000 (0:00:00.339) 0:00:39.478 ***** changed: [instance] TASK [reproducer : Ensure the required parameters are loaded] ****************** Thursday 27 November 2025 09:43:31 +0000 (0:00:00.323) 0:00:39.802 ***** changed: [instance] => (item=arptables) changed: [instance] => (item=iptables) changed: [instance] => (item=ip6tables) TASK [reproducer : Ensure firewall service is enabled and started] ************* Thursday 27 November 2025 09:43:32 +0000 (0:00:00.653) 0:00:40.455 ***** ok: [instance] TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* Thursday 27 November 2025 09:43:32 +0000 (0:00:00.340) 0:00:40.796 ***** ok: [instance] TASK [Ensure the required network configurations are applied] ****************** Thursday 27 November 2025 09:43:32 +0000 (0:00:00.095) 0:00:40.892 ***** TASK [networking_mapper : Check for Networking Environment Definition file existence] *** Thursday 27 November 2025 09:43:32 +0000 (0:00:00.047) 0:00:40.939 ***** skipping: [instance] TASK [networking_mapper : Check for Networking Definition file existance] ****** Thursday 27 November 2025 09:43:32 +0000 (0:00:00.026) 0:00:40.966 ***** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Thursday 27 November 2025 09:43:32 +0000 (0:00:00.029) 0:00:40.996 ***** skipping: [instance] TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** Thursday 27 November 2025 09:43:32 +0000 (0:00:00.029) 0:00:41.025 ***** skipping: [instance] TASK [ci_nmstate : Initialize NMstates for each instance] ********************** Thursday 27 November 2025 09:43:32 +0000 (0:00:00.034) 0:00:41.060 ***** ok: [instance] TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** Thursday 27 November 2025 09:43:33 +0000 (0:00:00.046) 0:00:41.107 ***** skipping: [instance] TASK [ci_nmstate : Get k8s nodes] ********************************************** Thursday 27 November 2025 09:43:33 +0000 (0:00:00.039) 0:00:41.146 ***** skipping: [instance] TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** Thursday 27 November 2025 09:43:33 +0000 (0:00:00.029) 0:00:41.175 ***** ok: [instance] TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* Thursday 27 November 2025 09:43:33 +0000 (0:00:00.058) 0:00:41.234 ***** skipping: [instance] TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* Thursday 27 November 2025 09:43:33 +0000 (0:00:00.028) 0:00:41.262 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) TASK [ci_nmstate : Ensure we have needed facts] ******************************** Thursday 27 November 2025 09:43:33 +0000 (0:00:00.055) 0:00:41.318 ***** ok: [instance -> localhost] TASK [ci_nmstate : Install required packages on localhost] ********************* Thursday 27 November 2025 09:43:33 +0000 (0:00:00.354) 0:00:41.672 ***** changed: [instance -> localhost] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Thursday 27 November 2025 09:43:38 +0000 (0:00:04.918) 0:00:46.590 ***** changed: [instance] TASK [ci_nmstate : Save nmstate state for localhost] *************************** Thursday 27 November 2025 09:43:38 +0000 (0:00:00.222) 0:00:46.813 ***** changed: [instance] TASK [ci_nmstate : Apply the desidered state on localhost] ********************* Thursday 27 November 2025 09:43:39 +0000 (0:00:00.372) 0:00:47.185 ***** changed: [instance -> localhost] TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** Thursday 27 November 2025 09:43:40 +0000 (0:00:01.672) 0:00:48.858 ***** changed: [instance] TASK [reproducer : Select right domain] **************************************** Thursday 27 November 2025 09:43:41 +0000 (0:00:00.377) 0:00:49.236 ***** ok: [instance] TASK [Create the virtual networks] ********************************************* Thursday 27 November 2025 09:43:41 +0000 (0:00:00.035) 0:00:49.272 ***** TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** Thursday 27 November 2025 09:43:41 +0000 (0:00:00.119) 0:00:49.391 ***** ok: [instance] TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* Thursday 27 November 2025 09:43:41 +0000 (0:00:00.021) 0:00:49.413 ***** ok: [instance] TASK [libvirt_manager : Load file if exists] *********************************** Thursday 27 November 2025 09:43:41 +0000 (0:00:00.204) 0:00:49.617 ***** skipping: [instance] TASK [libvirt_manager : Update fact with existing content] ********************* Thursday 27 November 2025 09:43:41 +0000 (0:00:00.033) 0:00:49.650 ***** skipping: [instance] TASK [libvirt_manager : Generate VM list] ************************************** Thursday 27 November 2025 09:43:41 +0000 (0:00:00.030) 0:00:49.681 ***** ok: [instance] TASK [libvirt_manager : Generate/update mapping all nodes] ********************* Thursday 27 November 2025 09:43:41 +0000 (0:00:00.058) 0:00:49.740 ***** ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Append baremetal nodes if needed] ********************** Thursday 27 November 2025 09:43:41 +0000 (0:00:00.131) 0:00:49.871 ***** skipping: [instance] TASK [libvirt_manager : Dump MAC mapping] ************************************** Thursday 27 November 2025 09:43:41 +0000 (0:00:00.038) 0:00:49.910 ***** changed: [instance] TASK [libvirt_manager : Inject all VMs in the inventory] *********************** Thursday 27 November 2025 09:43:42 +0000 (0:00:00.354) 0:00:50.264 ***** changed: [instance] => (item=Adding compute-0 to computes) changed: [instance] => (item=Adding controller-0 to controllers) changed: [instance] => (item=Adding crc-0 to ocps) TASK [networking_mapper : Check for Networking Definition file existence] ****** Thursday 27 November 2025 09:43:42 +0000 (0:00:00.121) 0:00:50.385 ***** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Thursday 27 November 2025 09:43:42 +0000 (0:00:00.025) 0:00:50.411 ***** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Thursday 27 November 2025 09:43:42 +0000 (0:00:00.025) 0:00:50.436 ***** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Thursday 27 November 2025 09:43:42 +0000 (0:00:00.028) 0:00:50.464 ***** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Thursday 27 November 2025 09:43:42 +0000 (0:00:00.026) 0:00:50.491 ***** ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Thursday 27 November 2025 09:43:42 +0000 (0:00:00.019) 0:00:50.510 ***** ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Thursday 27 November 2025 09:43:42 +0000 (0:00:00.084) 0:00:50.595 ***** skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Thursday 27 November 2025 09:43:42 +0000 (0:00:00.020) 0:00:50.615 ***** changed: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Thursday 27 November 2025 09:43:42 +0000 (0:00:00.221) 0:00:50.837 ***** changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Thursday 27 November 2025 09:43:43 +0000 (0:00:00.407) 0:00:51.244 ***** ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Thursday 27 November 2025 09:43:43 +0000 (0:00:00.065) 0:00:51.310 ***** ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Thursday 27 November 2025 09:43:43 +0000 (0:00:00.033) 0:00:51.343 ***** changed: [instance] TASK [libvirt_manager : Manage networks if needed] ***************************** Thursday 27 November 2025 09:43:43 +0000 (0:00:00.383) 0:00:51.726 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** Thursday 27 November 2025 09:43:43 +0000 (0:00:00.077) 0:00:51.804 ***** ok: [instance] => (item=public) ok: [instance] => (item=osp_trunk) TASK [libvirt_manager : Ensure networks are defined] *************************** Thursday 27 November 2025 09:43:43 +0000 (0:00:00.051) 0:00:51.855 ***** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are created/started] ******************* Thursday 27 November 2025 09:43:44 +0000 (0:00:00.437) 0:00:52.292 ***** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are active] **************************** Thursday 27 November 2025 09:43:44 +0000 (0:00:00.591) 0:00:52.883 ***** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** Thursday 27 November 2025 09:43:45 +0000 (0:00:00.434) 0:00:53.317 ***** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** Thursday 27 November 2025 09:43:45 +0000 (0:00:00.427) 0:00:53.745 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance TASK [libvirt_manager : Fetch present bridge interfaces] *********************** Thursday 27 November 2025 09:43:45 +0000 (0:00:00.060) 0:00:53.805 ***** ok: [instance] TASK [libvirt_manager : Fetch bridges ports link info] ************************* Thursday 27 November 2025 09:43:45 +0000 (0:00:00.186) 0:00:53.992 ***** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [Create dummy interfaces to ensure bridges are UP] ************************ Thursday 27 November 2025 09:43:46 +0000 (0:00:00.375) 0:00:54.368 ***** TASK [ci_nmstate : Ensure we have needed facts] ******************************** Thursday 27 November 2025 09:43:46 +0000 (0:00:00.069) 0:00:54.438 ***** skipping: [instance] TASK [ci_nmstate : Install required packages on instance] ********************** Thursday 27 November 2025 09:43:46 +0000 (0:00:00.066) 0:00:54.504 ***** ok: [instance] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Thursday 27 November 2025 09:43:47 +0000 (0:00:01.271) 0:00:55.776 ***** ok: [instance] TASK [ci_nmstate : Save nmstate state for instance] **************************** Thursday 27 November 2025 09:43:47 +0000 (0:00:00.204) 0:00:55.980 ***** changed: [instance] TASK [ci_nmstate : Apply the desidered state on instance] ********************** Thursday 27 November 2025 09:43:48 +0000 (0:00:00.363) 0:00:56.344 ***** changed: [instance] TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* Thursday 27 November 2025 09:43:49 +0000 (0:00:01.643) 0:00:57.987 ***** changed: [instance] TASK [Create extra network configuration] ************************************** Thursday 27 November 2025 09:43:50 +0000 (0:00:00.359) 0:00:58.346 ***** skipping: [instance] TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** Thursday 27 November 2025 09:43:50 +0000 (0:00:00.035) 0:00:58.382 ***** skipping: [instance] TASK [libvirt_manager : Refresh networking facts on host] ********************** Thursday 27 November 2025 09:43:50 +0000 (0:00:00.030) 0:00:58.412 ***** ok: [instance] TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** Thursday 27 November 2025 09:43:50 +0000 (0:00:00.451) 0:00:58.863 ***** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [dnsmasq : Install needed packages] *************************************** Thursday 27 November 2025 09:43:50 +0000 (0:00:00.146) 0:00:59.010 ***** ok: [instance] TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** Thursday 27 November 2025 09:43:52 +0000 (0:00:01.243) 0:01:00.254 ***** changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) TASK [dnsmasq : Manage configuration directory] ******************************** Thursday 27 November 2025 09:43:55 +0000 (0:00:03.721) 0:01:03.975 ***** changed: [instance] TASK [dnsmasq : Manage systemd unit file] ************************************** Thursday 27 November 2025 09:43:56 +0000 (0:00:00.215) 0:01:04.191 ***** changed: [instance] TASK [dnsmasq : Manage base configuration file] ******************************** Thursday 27 November 2025 09:43:56 +0000 (0:00:00.360) 0:01:04.551 ***** changed: [instance] TASK [dnsmasq : Render listener configuration] ********************************* Thursday 27 November 2025 09:43:56 +0000 (0:00:00.387) 0:01:04.939 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance TASK [dnsmasq : Create listener configuration file] **************************** Thursday 27 November 2025 09:43:56 +0000 (0:00:00.033) 0:01:04.973 ***** changed: [instance] TASK [dnsmasq : Remove listener configuration file] **************************** Thursday 27 November 2025 09:43:57 +0000 (0:00:00.393) 0:01:05.367 ***** skipping: [instance] TASK [dnsmasq : Render dns configuration] ************************************** Thursday 27 November 2025 09:43:57 +0000 (0:00:00.022) 0:01:05.389 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance TASK [dnsmasq : Create dns configuration file] ********************************* Thursday 27 November 2025 09:43:57 +0000 (0:00:00.033) 0:01:05.423 ***** changed: [instance] TASK [dnsmasq : Remove dns configuration file] ********************************* Thursday 27 November 2025 09:43:57 +0000 (0:00:00.375) 0:01:05.799 ***** skipping: [instance] TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** Thursday 27 November 2025 09:43:57 +0000 (0:00:00.022) 0:01:05.821 ***** ok: [instance] => (item=127.0.0.2) TASK [dnsmasq : Enable and start service] ************************************** Thursday 27 November 2025 09:43:57 +0000 (0:00:00.212) 0:01:06.033 ***** changed: [instance] TASK [dnsmasq : Stop service] ************************************************** Thursday 27 November 2025 09:43:58 +0000 (0:00:00.681) 0:01:06.714 ***** skipping: [instance] TASK [dnsmasq : Remove unit file] ********************************************** Thursday 27 November 2025 09:43:58 +0000 (0:00:00.021) 0:01:06.736 ***** skipping: [instance] TASK [dnsmasq : Remove main configuration files] ******************************* Thursday 27 November 2025 09:43:58 +0000 (0:00:00.018) 0:01:06.755 ***** skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) skipping: [instance] TASK [Create dnsmasq networks] ************************************************* Thursday 27 November 2025 09:43:58 +0000 (0:00:00.028) 0:01:06.784 ***** TASK [dnsmasq : Assert mandatory parameter] ************************************ Thursday 27 November 2025 09:43:58 +0000 (0:00:00.115) 0:01:06.899 ***** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Thursday 27 November 2025 09:43:58 +0000 (0:00:00.028) 0:01:06.928 ***** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Thursday 27 November 2025 09:43:58 +0000 (0:00:00.035) 0:01:06.964 ***** changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Thursday 27 November 2025 09:43:59 +0000 (0:00:00.463) 0:01:07.428 ***** skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Thursday 27 November 2025 09:43:59 +0000 (0:00:00.022) 0:01:07.450 ***** skipping: [instance] TASK [dnsmasq : Assert mandatory parameter] ************************************ Thursday 27 November 2025 09:43:59 +0000 (0:00:00.025) 0:01:07.476 ***** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Thursday 27 November 2025 09:43:59 +0000 (0:00:00.029) 0:01:07.505 ***** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Thursday 27 November 2025 09:43:59 +0000 (0:00:00.038) 0:01:07.544 ***** changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Thursday 27 November 2025 09:43:59 +0000 (0:00:00.476) 0:01:08.020 ***** skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Thursday 27 November 2025 09:43:59 +0000 (0:00:00.027) 0:01:08.048 ***** skipping: [instance] TASK [Deploy radvd for IPv6 router advertisements] ***************************** Thursday 27 November 2025 09:44:00 +0000 (0:00:00.031) 0:01:08.080 ***** skipping: [instance] TASK [libvirt_manager : Ensure network is in correct zone] ********************* Thursday 27 November 2025 09:44:00 +0000 (0:00:00.040) 0:01:08.120 ***** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Thursday 27 November 2025 09:44:00 +0000 (0:00:00.515) 0:01:08.635 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Thursday 27 November 2025 09:44:00 +0000 (0:00:00.044) 0:01:08.680 ***** ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Thursday 27 November 2025 09:44:00 +0000 (0:00:00.384) 0:01:09.065 ***** ok: [instance] TASK [libvirt_manager : Extract IP address from network bridges] *************** Thursday 27 November 2025 09:44:01 +0000 (0:00:00.046) 0:01:09.112 ***** ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Thursday 27 November 2025 09:44:01 +0000 (0:00:00.239) 0:01:09.351 ***** ok: [instance] TASK [libvirt_manager : Output _network_data] ********************************** Thursday 27 November 2025 09:44:01 +0000 (0:00:00.046) 0:01:09.398 ***** changed: [instance] TASK [libvirt_manager : Output pub_net] **************************************** Thursday 27 November 2025 09:44:01 +0000 (0:00:00.374) 0:01:09.772 ***** changed: [instance] TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** Thursday 27 November 2025 09:44:02 +0000 (0:00:00.360) 0:01:10.132 ***** changed: [instance] TASK [libvirt_manager : Expose patch for networking_mapper] ******************** Thursday 27 November 2025 09:44:02 +0000 (0:00:00.370) 0:01:10.503 ***** ok: [instance] TASK [libvirt_manager : Save networking_mapper patch] ************************** Thursday 27 November 2025 09:44:02 +0000 (0:00:00.110) 0:01:10.614 ***** changed: [instance] TASK [networking_mapper : Check for Networking Definition file existence] ****** Thursday 27 November 2025 09:44:02 +0000 (0:00:00.357) 0:01:10.971 ***** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Thursday 27 November 2025 09:44:02 +0000 (0:00:00.029) 0:01:11.001 ***** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Thursday 27 November 2025 09:44:02 +0000 (0:00:00.026) 0:01:11.027 ***** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Thursday 27 November 2025 09:44:02 +0000 (0:00:00.027) 0:01:11.054 ***** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Thursday 27 November 2025 09:44:03 +0000 (0:00:00.030) 0:01:11.085 ***** ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Thursday 27 November 2025 09:44:03 +0000 (0:00:00.023) 0:01:11.108 ***** ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Thursday 27 November 2025 09:44:03 +0000 (0:00:00.089) 0:01:11.197 ***** skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Thursday 27 November 2025 09:44:03 +0000 (0:00:00.020) 0:01:11.218 ***** ok: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Thursday 27 November 2025 09:44:03 +0000 (0:00:00.210) 0:01:11.429 ***** changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Thursday 27 November 2025 09:44:03 +0000 (0:00:00.417) 0:01:11.846 ***** ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Thursday 27 November 2025 09:44:03 +0000 (0:00:00.068) 0:01:11.914 ***** ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Thursday 27 November 2025 09:44:03 +0000 (0:00:00.035) 0:01:11.950 ***** changed: [instance] TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** Thursday 27 November 2025 09:44:04 +0000 (0:00:00.435) 0:01:12.386 ***** ok: [instance] TASK [libvirt_manager : Unset patch] ******************************************* Thursday 27 November 2025 09:44:04 +0000 (0:00:00.033) 0:01:12.419 ***** ok: [instance] TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** Thursday 27 November 2025 09:44:04 +0000 (0:00:00.021) 0:01:12.441 ***** ok: [instance] TASK [libvirt_manager : Reserve IPs on networks] ******************************* Thursday 27 November 2025 09:44:04 +0000 (0:00:00.020) 0:01:12.461 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 27 November 2025 09:44:04 +0000 (0:00:00.074) 0:01:12.536 ***** ok: [instance] => (item=compute-0 - ctlplane) ok: [instance] => (item=controller-0 - ctlplane) ok: [instance] => (item=crc-0 - ctlplane) TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 27 November 2025 09:44:04 +0000 (0:00:00.136) 0:01:12.672 ***** skipping: [instance] => (item=compute-0 - internalapi) skipping: [instance] => (item=controller-0 - internalapi) skipping: [instance] => (item=crc-0 - internalapi) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 27 November 2025 09:44:04 +0000 (0:00:00.080) 0:01:12.752 ***** skipping: [instance] => (item=compute-0 - storage) skipping: [instance] => (item=controller-0 - storage) skipping: [instance] => (item=crc-0 - storage) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 27 November 2025 09:44:04 +0000 (0:00:00.082) 0:01:12.835 ***** skipping: [instance] => (item=compute-0 - tenant) skipping: [instance] => (item=controller-0 - tenant) skipping: [instance] => (item=crc-0 - tenant) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 27 November 2025 09:44:04 +0000 (0:00:00.082) 0:01:12.918 ***** skipping: [instance] => (item=compute-0 - external) skipping: [instance] => (item=controller-0 - external) skipping: [instance] => (item=crc-0 - external) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 27 November 2025 09:44:04 +0000 (0:00:00.080) 0:01:12.999 ***** skipping: [instance] => (item=compute-0 - storagemgmt) skipping: [instance] => (item=controller-0 - storagemgmt) skipping: [instance] => (item=crc-0 - storagemgmt) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 27 November 2025 09:44:05 +0000 (0:00:00.077) 0:01:13.076 ***** ok: [instance] => (item=compute-0 - public) ok: [instance] => (item=controller-0 - public) ok: [instance] => (item=crc-0 - public) TASK [Inject DHCP entries for net {{ net_name }}] ****************************** Thursday 27 November 2025 09:44:05 +0000 (0:00:00.228) 0:01:13.304 ***** TASK [dnsmasq : Ensure we have the right data and type] ************************ Thursday 27 November 2025 09:44:05 +0000 (0:00:00.168) 0:01:13.472 ***** ok: [instance] TASK [dnsmasq : Assert we have needed host data] ******************************* Thursday 27 November 2025 09:44:05 +0000 (0:00:00.045) 0:01:13.518 ***** ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:35:68:6a', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:66:67:87', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:3f:7f:18', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7a:68:be', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:c9:1a:5a', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:c8:6a:65', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) TASK [dnsmasq : Ensure networks exists] **************************************** Thursday 27 November 2025 09:44:05 +0000 (0:00:00.114) 0:01:13.632 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) TASK [dnsmasq : Check network file status] ************************************* Thursday 27 November 2025 09:44:05 +0000 (0:00:00.057) 0:01:13.689 ***** ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Thursday 27 November 2025 09:44:05 +0000 (0:00:00.199) 0:01:13.889 ***** ok: [instance] TASK [dnsmasq : Check network file status] ************************************* Thursday 27 November 2025 09:44:05 +0000 (0:00:00.028) 0:01:13.917 ***** ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Thursday 27 November 2025 09:44:06 +0000 (0:00:00.209) 0:01:14.127 ***** ok: [instance] TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** Thursday 27 November 2025 09:44:06 +0000 (0:00:00.031) 0:01:14.158 ***** ok: [instance] TASK [dnsmasq : Compute entry] ************************************************* Thursday 27 November 2025 09:44:06 +0000 (0:00:00.024) 0:01:14.183 ***** ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:35:68:6a', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:66:67:87', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:3f:7f:18', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7a:68:be', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:c9:1a:5a', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:c8:6a:65', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) TASK [dnsmasq : Create add/remove sets] **************************************** Thursday 27 November 2025 09:44:06 +0000 (0:00:00.184) 0:01:14.367 ***** ok: [instance] TASK [dnsmasq : Add DHCP entries] ********************************************** Thursday 27 November 2025 09:44:06 +0000 (0:00:00.044) 0:01:14.412 ***** changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:35:68:6a', 'entry': 'set:compute,52:54:00:35:68:6a,192.168.140.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:66:67:87', 'entry': 'set:controller,52:54:01:66:67:87,192.168.140.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:3f:7f:18', 'entry': 'set:ocp,52:54:02:3f:7f:18,192.168.140.10,crc-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_compute-0_52:54:00:7a:68:be', 'entry': 'set:compute,52:54:00:7a:68:be,192.168.101.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_controller-0_52:54:01:c9:1a:5a', 'entry': 'set:controller,52:54:01:c9:1a:5a,192.168.101.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_crc-0_52:54:02:c8:6a:65', 'entry': 'set:ocp,52:54:02:c8:6a:65,192.168.101.10,crc-0', 'state': 'present'}) TASK [dnsmasq : Remove DHCP entries] ******************************************* Thursday 27 November 2025 09:44:08 +0000 (0:00:02.240) 0:01:16.652 ***** skipping: [instance] TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** Thursday 27 November 2025 09:44:08 +0000 (0:00:00.026) 0:01:16.679 ***** ok: [instance] => (item=compute-0) ok: [instance] => (item=controller-0) ok: [instance] => (item=crc-0) TASK [Inject VMs in the .utility zone] ***************************************** Thursday 27 November 2025 09:44:08 +0000 (0:00:00.219) 0:01:16.898 ***** TASK [dnsmasq : Assert we have needed host record data] ************************ Thursday 27 November 2025 09:44:08 +0000 (0:00:00.124) 0:01:17.023 ***** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Thursday 27 November 2025 09:44:09 +0000 (0:00:00.055) 0:01:17.078 ***** ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Thursday 27 November 2025 09:44:09 +0000 (0:00:00.207) 0:01:17.286 ***** changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** Thursday 27 November 2025 09:44:12 +0000 (0:00:03.423) 0:01:20.710 ***** ok: [instance] TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** Thursday 27 November 2025 09:44:12 +0000 (0:00:00.031) 0:01:20.741 ***** skipping: [instance] => (item=compute) skipping: [instance] => (item=controller) skipping: [instance] => (item=crc) skipping: [instance] TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* Thursday 27 November 2025 09:44:12 +0000 (0:00:00.056) 0:01:20.798 ***** skipping: [instance] TASK [libvirt_manager : Ensure some domains are local] ************************* Thursday 27 November 2025 09:44:12 +0000 (0:00:00.037) 0:01:20.835 ***** changed: [instance] TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ Thursday 27 November 2025 09:44:13 +0000 (0:00:00.406) 0:01:21.242 ***** RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Thursday 27 November 2025 09:44:13 +0000 (0:00:00.011) 0:01:21.253 ***** changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Thursday 27 November 2025 09:44:14 +0000 (0:00:00.859) 0:01:22.112 ***** changed: [instance] RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* Thursday 27 November 2025 09:44:14 +0000 (0:00:00.377) 0:01:22.490 ***** changed: [instance] TASK [reproducer : Delegate our domains to our own instance] ******************* Thursday 27 November 2025 09:44:14 +0000 (0:00:00.374) 0:01:22.865 ***** changed: [instance] TASK [reproducer : Ensure "utility" domain is local] *************************** Thursday 27 November 2025 09:44:15 +0000 (0:00:00.374) 0:01:23.239 ***** changed: [instance] TASK [Build utility records dataset] ******************************************* Thursday 27 November 2025 09:44:15 +0000 (0:00:00.391) 0:01:23.631 ***** TASK [dnsmasq : Assert we have needed host record data] ************************ Thursday 27 November 2025 09:44:15 +0000 (0:00:00.066) 0:01:23.697 ***** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Thursday 27 November 2025 09:44:15 +0000 (0:00:00.095) 0:01:23.793 ***** ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Thursday 27 November 2025 09:44:15 +0000 (0:00:00.102) 0:01:23.895 ***** changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [reproducer : Flush handlers] ********************************************* Thursday 27 November 2025 09:44:16 +0000 (0:00:00.499) 0:01:24.394 ***** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Thursday 27 November 2025 09:44:16 +0000 (0:00:00.010) 0:01:24.404 ***** changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Thursday 27 November 2025 09:44:16 +0000 (0:00:00.489) 0:01:24.893 ***** changed: [instance] TASK [reproducer : Bootstrap nat64 if needed] ********************************** Thursday 27 November 2025 09:44:17 +0000 (0:00:00.394) 0:01:25.288 ***** skipping: [instance] TASK [reproducer : Deploy CRC if needed] *************************************** Thursday 27 November 2025 09:44:17 +0000 (0:00:00.041) 0:01:25.329 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance TASK [reproducer : Check for CRC availability in known path] ******************* Thursday 27 November 2025 09:44:17 +0000 (0:00:00.086) 0:01:25.416 ***** ok: [instance] TASK [Deploy CRC if needed] **************************************************** Thursday 27 November 2025 09:44:17 +0000 (0:00:00.202) 0:01:25.618 ***** skipping: [instance] TASK [rhol_crc : Stop CRC VM] ************************************************** Thursday 27 November 2025 09:44:17 +0000 (0:00:00.028) 0:01:25.646 ***** ok: [instance] TASK [rhol_crc : Undefine CRC VM] ********************************************** Thursday 27 November 2025 09:44:17 +0000 (0:00:00.381) 0:01:26.028 ***** ok: [instance] TASK [rhol_crc : Destroy CRC network] ****************************************** Thursday 27 November 2025 09:44:18 +0000 (0:00:00.234) 0:01:26.262 ***** ok: [instance] TASK [rhol_crc : Undefine CRC network] ***************************************** Thursday 27 November 2025 09:44:18 +0000 (0:00:00.226) 0:01:26.489 ***** ok: [instance] TASK [rhol_crc : Destroy default network] ************************************** Thursday 27 November 2025 09:44:18 +0000 (0:00:00.224) 0:01:26.713 ***** ok: [instance] TASK [Check if new ssh keypair exists] ***************************************** Thursday 27 November 2025 09:44:18 +0000 (0:00:00.243) 0:01:26.956 ***** TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Thursday 27 November 2025 09:44:18 +0000 (0:00:00.046) 0:01:27.003 ***** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Thursday 27 November 2025 09:44:19 +0000 (0:00:00.212) 0:01:27.215 ***** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Thursday 27 November 2025 09:44:19 +0000 (0:00:00.030) 0:01:27.246 ***** skipping: [instance] TASK [reproducer : Slurp ssh key for CRC access] ******************************* Thursday 27 November 2025 09:44:19 +0000 (0:00:00.031) 0:01:27.277 ***** ok: [instance] TASK [reproducer : Get kubeconfig file from crc directory] ********************* Thursday 27 November 2025 09:44:19 +0000 (0:00:00.318) 0:01:27.596 ***** ok: [instance] TASK [reproducer : Get kubeadmin-password file from crc directory] ************* Thursday 27 November 2025 09:44:19 +0000 (0:00:00.234) 0:01:27.830 ***** ok: [instance] TASK [Ensure we expose openshift_login related facts] ************************** Thursday 27 November 2025 09:44:19 +0000 (0:00:00.174) 0:01:28.005 ***** TASK [openshift_login : Assert we have needed parameters] ********************** Thursday 27 November 2025 09:44:20 +0000 (0:00:00.065) 0:01:28.070 ***** ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Stat kubeconfig] *************************************** Thursday 27 November 2025 09:44:20 +0000 (0:00:00.048) 0:01:28.118 ***** ok: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Thursday 27 November 2025 09:44:20 +0000 (0:00:00.203) 0:01:28.322 ***** ok: [instance] TASK [openshift_login : Assert files exist] ************************************ Thursday 27 November 2025 09:44:20 +0000 (0:00:00.218) 0:01:28.540 ***** ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Gather the password of the deployed cluster.] ********** Thursday 27 November 2025 09:44:20 +0000 (0:00:00.033) 0:01:28.574 ***** ok: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Thursday 27 November 2025 09:44:20 +0000 (0:00:00.206) 0:01:28.781 ***** ok: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Thursday 27 November 2025 09:44:20 +0000 (0:00:00.186) 0:01:28.968 ***** ok: [instance] TASK [reproducer : Remove CRC managed zone delegation] ************************* Thursday 27 November 2025 09:44:20 +0000 (0:00:00.052) 0:01:29.021 ***** changed: [instance] => (item=dnsmasq.d/crc.conf) changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ Thursday 27 November 2025 09:44:21 +0000 (0:00:00.402) 0:01:29.424 ***** skipping: [instance] TASK [Load the architecture local kustomize patches] *************************** Thursday 27 November 2025 09:44:21 +0000 (0:00:00.022) 0:01:29.446 ***** skipping: [instance] TASK [reproducer : Consume libvirt_manager] ************************************ Thursday 27 November 2025 09:44:21 +0000 (0:00:00.026) 0:01:29.473 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance TASK [libvirt_manager : Import layout generator if needed] ********************* Thursday 27 November 2025 09:44:21 +0000 (0:00:00.167) 0:01:29.640 ***** skipping: [instance] TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** Thursday 27 November 2025 09:44:21 +0000 (0:00:00.028) 0:01:29.669 ***** changed: [instance] TASK [libvirt_manager : Enable masquerading for public traffic] **************** Thursday 27 November 2025 09:44:22 +0000 (0:00:00.423) 0:01:30.092 ***** changed: [instance] TASK [libvirt_manager : Ensure firewalld is restarts] ************************** Thursday 27 November 2025 09:44:22 +0000 (0:00:00.495) 0:01:30.587 ***** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Thursday 27 November 2025 09:44:22 +0000 (0:00:00.010) 0:01:30.598 ***** changed: [instance] RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Thursday 27 November 2025 09:44:22 +0000 (0:00:00.455) 0:01:31.053 ***** changed: [instance] TASK [Deploy virtualbmc] ******************************************************* Thursday 27 November 2025 09:44:23 +0000 (0:00:00.881) 0:01:31.935 ***** skipping: [instance] TASK [libvirt_manager : Let the project know we have vbmc available] *********** Thursday 27 November 2025 09:44:23 +0000 (0:00:00.042) 0:01:31.977 ***** skipping: [instance] TASK [libvirt_manager : Create needed workload directory] ********************** Thursday 27 November 2025 09:44:23 +0000 (0:00:00.038) 0:01:32.015 ***** changed: [instance] => (item=workload) changed: [instance] => (item=reproducer-inventory) ok: [instance] => (item=volumes) TASK [libvirt_manager : Allow QEMU on workload directory] ********************** Thursday 27 November 2025 09:44:24 +0000 (0:00:00.593) 0:01:32.609 ***** changed: [instance] => (item=workload) changed: [instance] => (item=volumes) TASK [libvirt_manager : Generate networking data] ****************************** Thursday 27 November 2025 09:44:24 +0000 (0:00:00.454) 0:01:33.064 ***** skipping: [instance] TASK [libvirt_manager : Create group inventories] ****************************** Thursday 27 November 2025 09:44:25 +0000 (0:00:00.030) 0:01:33.094 ***** changed: [instance] => (item=compute) changed: [instance] => (item=controller) changed: [instance] => (item=crc) TASK [libvirt_manager : Create "all" group inventory file] ********************* Thursday 27 November 2025 09:44:26 +0000 (0:00:01.100) 0:01:34.195 ***** changed: [instance] TASK [libvirt_manager : Ensure storage pool is present.] *********************** Thursday 27 November 2025 09:44:26 +0000 (0:00:00.400) 0:01:34.596 ***** skipping: [instance] TASK [libvirt_manager : Ensure images are present] ***************************** Thursday 27 November 2025 09:44:26 +0000 (0:00:00.045) 0:01:34.641 ***** skipping: [instance] => (item=crc) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) TASK [libvirt_manager : Ensure directory exists] ******************************* Thursday 27 November 2025 09:44:26 +0000 (0:00:00.067) 0:01:34.708 ***** changed: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Thursday 27 November 2025 09:44:26 +0000 (0:00:00.234) 0:01:34.943 ***** ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Thursday 27 November 2025 09:44:27 +0000 (0:00:00.203) 0:01:35.146 ***** changed: [instance] TASK [libvirt_manager : Check image] ******************************************* Thursday 27 November 2025 09:44:49 +0000 (0:00:21.923) 0:01:57.070 ***** ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Thursday 27 November 2025 09:44:49 +0000 (0:00:00.210) 0:01:57.281 ***** ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Thursday 27 November 2025 09:44:49 +0000 (0:00:00.051) 0:01:57.333 ***** changed: [instance] TASK [libvirt_manager : Ensure directory exists] ******************************* Thursday 27 November 2025 09:44:49 +0000 (0:00:00.234) 0:01:57.567 ***** ok: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Thursday 27 November 2025 09:44:49 +0000 (0:00:00.226) 0:01:57.793 ***** ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Thursday 27 November 2025 09:44:49 +0000 (0:00:00.209) 0:01:58.002 ***** skipping: [instance] TASK [libvirt_manager : Check image] ******************************************* Thursday 27 November 2025 09:44:49 +0000 (0:00:00.028) 0:01:58.030 ***** ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Thursday 27 November 2025 09:44:50 +0000 (0:00:00.211) 0:01:58.242 ***** ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Thursday 27 November 2025 09:44:50 +0000 (0:00:00.048) 0:01:58.290 ***** ok: [instance] TASK [libvirt_manager : Get ssh key state] ************************************* Thursday 27 November 2025 09:44:50 +0000 (0:00:00.220) 0:01:58.510 ***** ok: [instance] TASK [libvirt_manager : Create temporary ssh keypair] ************************** Thursday 27 November 2025 09:44:50 +0000 (0:00:00.203) 0:01:58.714 ***** changed: [instance] TASK [libvirt_manager : Slurp public key for later use] ************************ Thursday 27 November 2025 09:44:51 +0000 (0:00:00.441) 0:01:59.156 ***** ok: [instance] TASK [libvirt_manager : Slurp private key for later use] *********************** Thursday 27 November 2025 09:44:51 +0000 (0:00:00.197) 0:01:59.353 ***** ok: [instance] TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** Thursday 27 November 2025 09:44:51 +0000 (0:00:00.183) 0:01:59.536 ***** changed: [instance] TASK [libvirt_manager : Create fact holding network data for VMs] ************** Thursday 27 November 2025 09:44:51 +0000 (0:00:00.433) 0:01:59.970 ***** ok: [instance] TASK [libvirt_manager : List existing networks] ******************************** Thursday 27 November 2025 09:44:51 +0000 (0:00:00.024) 0:01:59.994 ***** ok: [instance] TASK [libvirt_manager : Gather pool fact] ************************************** Thursday 27 November 2025 09:44:52 +0000 (0:00:00.232) 0:02:00.227 ***** ok: [instance] TASK [libvirt_manager : Create and run VMs] ************************************ Thursday 27 November 2025 09:44:52 +0000 (0:00:00.505) 0:02:00.733 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Create VM image for compute-0] ************************* Thursday 27 November 2025 09:44:52 +0000 (0:00:00.123) 0:02:00.857 ***** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** Thursday 27 November 2025 09:44:53 +0000 (0:00:00.304) 0:02:01.161 ***** changed: [instance] TASK [libvirt_manager : Define VMs for type compute-0] ************************* Thursday 27 November 2025 09:44:53 +0000 (0:00:00.239) 0:02:01.401 ***** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** Thursday 27 November 2025 09:44:53 +0000 (0:00:00.341) 0:02:01.742 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Thursday 27 November 2025 09:44:53 +0000 (0:00:00.031) 0:02:01.774 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Thursday 27 November 2025 09:44:53 +0000 (0:00:00.048) 0:02:01.823 ***** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 27 November 2025 09:44:53 +0000 (0:00:00.246) 0:02:02.069 ***** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 27 November 2025 09:44:54 +0000 (0:00:00.051) 0:02:02.120 ***** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 27 November 2025 09:44:54 +0000 (0:00:00.235) 0:02:02.356 ***** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ Thursday 27 November 2025 09:44:54 +0000 (0:00:00.206) 0:02:02.563 ***** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Thursday 27 November 2025 09:44:54 +0000 (0:00:00.324) 0:02:02.887 ***** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 27 November 2025 09:44:55 +0000 (0:00:00.255) 0:02:03.143 ***** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 27 November 2025 09:44:55 +0000 (0:00:00.049) 0:02:03.192 ***** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 27 November 2025 09:44:55 +0000 (0:00:00.248) 0:02:03.441 ***** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* Thursday 27 November 2025 09:44:55 +0000 (0:00:00.246) 0:02:03.688 ***** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** Thursday 27 November 2025 09:44:55 +0000 (0:00:00.317) 0:02:04.006 ***** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** Thursday 27 November 2025 09:44:55 +0000 (0:00:00.029) 0:02:04.035 ***** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** Thursday 27 November 2025 09:44:56 +0000 (0:00:00.036) 0:02:04.071 ***** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** Thursday 27 November 2025 09:44:56 +0000 (0:00:00.034) 0:02:04.106 ***** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Thursday 27 November 2025 09:44:56 +0000 (0:00:00.033) 0:02:04.139 ***** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Thursday 27 November 2025 09:44:56 +0000 (0:00:00.237) 0:02:04.377 ***** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Thursday 27 November 2025 09:44:56 +0000 (0:00:00.041) 0:02:04.419 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Thursday 27 November 2025 09:44:56 +0000 (0:00:00.057) 0:02:04.477 ***** ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Thursday 27 November 2025 09:44:56 +0000 (0:00:00.210) 0:02:04.687 ***** ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Thursday 27 November 2025 09:44:56 +0000 (0:00:00.068) 0:02:04.755 ***** ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Thursday 27 November 2025 09:44:56 +0000 (0:00:00.052) 0:02:04.808 ***** skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Thursday 27 November 2025 09:44:56 +0000 (0:00:00.050) 0:02:04.858 ***** skipping: [instance] TASK [Call the config_drive role] ********************************************** Thursday 27 November 2025 09:44:56 +0000 (0:00:00.047) 0:02:04.905 ***** TASK [config_drive : Ensure needed directories exist] ************************** Thursday 27 November 2025 09:44:56 +0000 (0:00:00.070) 0:02:04.975 ***** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Thursday 27 November 2025 09:44:57 +0000 (0:00:00.437) 0:02:05.413 ***** ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Thursday 27 November 2025 09:44:58 +0000 (0:00:01.255) 0:02:06.669 ***** changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Thursday 27 November 2025 09:44:58 +0000 (0:00:00.228) 0:02:06.898 ***** changed: [instance] TASK [config_drive : Generate user-data] *************************************** Thursday 27 November 2025 09:44:59 +0000 (0:00:00.373) 0:02:07.271 ***** changed: [instance] TASK [config_drive : Generate network-data] ************************************ Thursday 27 November 2025 09:44:59 +0000 (0:00:00.439) 0:02:07.711 ***** skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Thursday 27 November 2025 09:44:59 +0000 (0:00:00.048) 0:02:07.759 ***** ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Thursday 27 November 2025 09:44:59 +0000 (0:00:00.224) 0:02:07.984 ***** skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Thursday 27 November 2025 09:45:00 +0000 (0:00:00.093) 0:02:08.077 ***** Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Thursday 27 November 2025 09:45:00 +0000 (0:00:00.326) 0:02:08.404 ***** changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Thursday 27 November 2025 09:45:00 +0000 (0:00:00.296) 0:02:08.700 ***** skipping: [instance] TASK [libvirt_manager : Configure boot order for compute-0] ******************** Thursday 27 November 2025 09:45:00 +0000 (0:00:00.057) 0:02:08.758 ***** skipping: [instance] TASK [libvirt_manager : Create VM image for controller-0] ********************** Thursday 27 November 2025 09:45:00 +0000 (0:00:00.035) 0:02:08.794 ***** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** Thursday 27 November 2025 09:45:00 +0000 (0:00:00.269) 0:02:09.063 ***** changed: [instance] TASK [libvirt_manager : Define VMs for type controller-0] ********************** Thursday 27 November 2025 09:45:01 +0000 (0:00:00.239) 0:02:09.302 ***** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** Thursday 27 November 2025 09:45:01 +0000 (0:00:00.311) 0:02:09.614 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Thursday 27 November 2025 09:45:01 +0000 (0:00:00.038) 0:02:09.653 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Thursday 27 November 2025 09:45:01 +0000 (0:00:00.057) 0:02:09.711 ***** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 27 November 2025 09:45:01 +0000 (0:00:00.259) 0:02:09.970 ***** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 27 November 2025 09:45:01 +0000 (0:00:00.057) 0:02:10.027 ***** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 27 November 2025 09:45:02 +0000 (0:00:00.260) 0:02:10.288 ***** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* Thursday 27 November 2025 09:45:02 +0000 (0:00:00.215) 0:02:10.503 ***** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Thursday 27 November 2025 09:45:02 +0000 (0:00:00.302) 0:02:10.805 ***** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 27 November 2025 09:45:02 +0000 (0:00:00.257) 0:02:11.062 ***** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 27 November 2025 09:45:03 +0000 (0:00:00.054) 0:02:11.117 ***** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 27 November 2025 09:45:03 +0000 (0:00:00.248) 0:02:11.366 ***** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** Thursday 27 November 2025 09:45:03 +0000 (0:00:00.213) 0:02:11.580 ***** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** Thursday 27 November 2025 09:45:03 +0000 (0:00:00.302) 0:02:11.882 ***** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** Thursday 27 November 2025 09:45:03 +0000 (0:00:00.027) 0:02:11.910 ***** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** Thursday 27 November 2025 09:45:03 +0000 (0:00:00.032) 0:02:11.943 ***** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** Thursday 27 November 2025 09:45:03 +0000 (0:00:00.032) 0:02:11.975 ***** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Thursday 27 November 2025 09:45:03 +0000 (0:00:00.037) 0:02:12.012 ***** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Thursday 27 November 2025 09:45:04 +0000 (0:00:00.241) 0:02:12.254 ***** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Thursday 27 November 2025 09:45:04 +0000 (0:00:00.051) 0:02:12.305 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Thursday 27 November 2025 09:45:04 +0000 (0:00:00.061) 0:02:12.366 ***** ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Thursday 27 November 2025 09:45:04 +0000 (0:00:00.223) 0:02:12.589 ***** ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Thursday 27 November 2025 09:45:04 +0000 (0:00:00.068) 0:02:12.657 ***** ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Thursday 27 November 2025 09:45:04 +0000 (0:00:00.052) 0:02:12.710 ***** skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Thursday 27 November 2025 09:45:04 +0000 (0:00:00.055) 0:02:12.766 ***** skipping: [instance] TASK [Call the config_drive role] ********************************************** Thursday 27 November 2025 09:45:04 +0000 (0:00:00.053) 0:02:12.820 ***** TASK [config_drive : Ensure needed directories exist] ************************** Thursday 27 November 2025 09:45:04 +0000 (0:00:00.065) 0:02:12.886 ***** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Thursday 27 November 2025 09:45:05 +0000 (0:00:00.422) 0:02:13.308 ***** ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Thursday 27 November 2025 09:45:06 +0000 (0:00:01.254) 0:02:14.562 ***** changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Thursday 27 November 2025 09:45:06 +0000 (0:00:00.232) 0:02:14.795 ***** changed: [instance] TASK [config_drive : Generate user-data] *************************************** Thursday 27 November 2025 09:45:07 +0000 (0:00:00.385) 0:02:15.180 ***** changed: [instance] TASK [config_drive : Generate network-data] ************************************ Thursday 27 November 2025 09:45:07 +0000 (0:00:00.405) 0:02:15.586 ***** skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Thursday 27 November 2025 09:45:07 +0000 (0:00:00.047) 0:02:15.634 ***** ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Thursday 27 November 2025 09:45:07 +0000 (0:00:00.213) 0:02:15.848 ***** skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Thursday 27 November 2025 09:45:07 +0000 (0:00:00.050) 0:02:15.898 ***** Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Thursday 27 November 2025 09:45:08 +0000 (0:00:00.278) 0:02:16.177 ***** changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Thursday 27 November 2025 09:45:08 +0000 (0:00:00.304) 0:02:16.481 ***** skipping: [instance] TASK [libvirt_manager : Configure boot order for controller-0] ***************** Thursday 27 November 2025 09:45:08 +0000 (0:00:00.054) 0:02:16.535 ***** skipping: [instance] TASK [libvirt_manager : Create VM image for crc-0] ***************************** Thursday 27 November 2025 09:45:08 +0000 (0:00:00.038) 0:02:16.574 ***** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ Thursday 27 November 2025 09:45:08 +0000 (0:00:00.277) 0:02:16.851 ***** changed: [instance] TASK [libvirt_manager : Define VMs for type crc-0] ***************************** Thursday 27 November 2025 09:45:09 +0000 (0:00:00.248) 0:02:17.099 ***** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** Thursday 27 November 2025 09:45:09 +0000 (0:00:00.382) 0:02:17.482 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Thursday 27 November 2025 09:45:09 +0000 (0:00:00.038) 0:02:17.520 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Thursday 27 November 2025 09:45:09 +0000 (0:00:00.053) 0:02:17.573 ***** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 27 November 2025 09:45:09 +0000 (0:00:00.273) 0:02:17.847 ***** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 27 November 2025 09:45:09 +0000 (0:00:00.057) 0:02:17.904 ***** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 27 November 2025 09:45:10 +0000 (0:00:00.258) 0:02:18.163 ***** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** Thursday 27 November 2025 09:45:10 +0000 (0:00:00.226) 0:02:18.390 ***** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Thursday 27 November 2025 09:45:10 +0000 (0:00:00.314) 0:02:18.705 ***** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 27 November 2025 09:45:10 +0000 (0:00:00.265) 0:02:18.970 ***** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 27 November 2025 09:45:10 +0000 (0:00:00.057) 0:02:19.028 ***** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 27 November 2025 09:45:11 +0000 (0:00:00.252) 0:02:19.281 ***** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* Thursday 27 November 2025 09:45:11 +0000 (0:00:00.218) 0:02:19.499 ***** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* Thursday 27 November 2025 09:45:11 +0000 (0:00:00.293) 0:02:19.793 ***** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ Thursday 27 November 2025 09:45:11 +0000 (0:00:00.028) 0:02:19.821 ***** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** Thursday 27 November 2025 09:45:11 +0000 (0:00:00.036) 0:02:19.858 ***** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** Thursday 27 November 2025 09:45:11 +0000 (0:00:00.035) 0:02:19.893 ***** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Thursday 27 November 2025 09:45:11 +0000 (0:00:00.033) 0:02:19.927 ***** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Thursday 27 November 2025 09:45:12 +0000 (0:00:00.241) 0:02:20.169 ***** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Thursday 27 November 2025 09:45:12 +0000 (0:00:00.039) 0:02:20.209 ***** skipping: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Thursday 27 November 2025 09:45:12 +0000 (0:00:00.030) 0:02:20.239 ***** skipping: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Thursday 27 November 2025 09:45:12 +0000 (0:00:00.035) 0:02:20.274 ***** skipping: [instance] TASK [libvirt_manager : Configure boot order for crc-0] ************************ Thursday 27 November 2025 09:45:12 +0000 (0:00:00.049) 0:02:20.323 ***** skipping: [instance] TASK [libvirt_manager : Start (power-on) VMs] ********************************** Thursday 27 November 2025 09:45:12 +0000 (0:00:00.028) 0:02:20.351 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** Thursday 27 November 2025 09:45:12 +0000 (0:00:00.062) 0:02:20.414 ***** ok: [instance] => (item=crc) TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** Thursday 27 November 2025 09:45:12 +0000 (0:00:00.260) 0:02:20.675 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Start vm] ********************************************** Thursday 27 November 2025 09:45:14 +0000 (0:00:02.079) 0:02:22.755 ***** changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Thursday 27 November 2025 09:45:15 +0000 (0:00:00.622) 0:02:23.377 ***** changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Thursday 27 November 2025 09:45:15 +0000 (0:00:00.547) 0:02:23.925 ***** changed: [instance] TASK [libvirt_manager : Wait for SSH on started VMs] *************************** Thursday 27 November 2025 09:45:16 +0000 (0:00:00.561) 0:02:24.487 ***** changed: [instance] => (item=compute-0.utility) changed: [instance] => (item=controller-0.utility) changed: [instance] => (item=crc-0.utility) TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** Thursday 27 November 2025 09:45:17 +0000 (0:00:00.764) 0:02:25.251 ***** FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j651439009898.21354', 'results_file': '/home/zuul/.ansible_async/j651439009898.21354', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j788928934275.21371', 'results_file': '/home/zuul/.ansible_async/j788928934275.21371', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j877827931351.21387', 'results_file': '/home/zuul/.ansible_async/j877827931351.21387', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) TASK [libvirt_manager : Configure managed VMs] ********************************* Thursday 27 November 2025 09:45:40 +0000 (0:00:23.077) 0:02:48.329 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [Check if new ssh keypair exists] ***************************************** Thursday 27 November 2025 09:45:40 +0000 (0:00:00.120) 0:02:48.449 ***** skipping: [instance] TASK [Push ssh jumper/configuration for compute-0] ***************************** Thursday 27 November 2025 09:45:40 +0000 (0:00:00.024) 0:02:48.474 ***** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Thursday 27 November 2025 09:45:40 +0000 (0:00:00.041) 0:02:48.516 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Thursday 27 November 2025 09:45:40 +0000 (0:00:00.080) 0:02:48.596 ***** changed: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Thursday 27 November 2025 09:45:40 +0000 (0:00:00.263) 0:02:48.860 ***** changed: [instance] TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* Thursday 27 November 2025 09:45:41 +0000 (0:00:00.232) 0:02:49.092 ***** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** Thursday 27 November 2025 09:45:41 +0000 (0:00:00.395) 0:02:49.488 ***** skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Thursday 27 November 2025 09:45:41 +0000 (0:00:00.029) 0:02:49.518 ***** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** Thursday 27 November 2025 09:45:41 +0000 (0:00:00.031) 0:02:49.550 ***** skipping: [instance] TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** Thursday 27 November 2025 09:45:41 +0000 (0:00:00.055) 0:02:49.605 ***** skipping: [instance] TASK [Check if new ssh keypair exists] ***************************************** Thursday 27 November 2025 09:45:41 +0000 (0:00:00.053) 0:02:49.659 ***** skipping: [instance] TASK [Push ssh jumper/configuration for controller-0] ************************** Thursday 27 November 2025 09:45:41 +0000 (0:00:00.027) 0:02:49.687 ***** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Thursday 27 November 2025 09:45:41 +0000 (0:00:00.041) 0:02:49.729 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Thursday 27 November 2025 09:45:41 +0000 (0:00:00.081) 0:02:49.810 ***** ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Thursday 27 November 2025 09:45:41 +0000 (0:00:00.222) 0:02:50.032 ***** ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** Thursday 27 November 2025 09:45:42 +0000 (0:00:00.230) 0:02:50.262 ***** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** Thursday 27 November 2025 09:45:42 +0000 (0:00:00.412) 0:02:50.674 ***** skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Thursday 27 November 2025 09:45:42 +0000 (0:00:00.035) 0:02:50.710 ***** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts controller-0] ************** Thursday 27 November 2025 09:45:42 +0000 (0:00:00.034) 0:02:50.744 ***** changed: [instance -> controller-0.instance] TASK [libvirt_manager : Inject public key on hosts controller-0] *************** Thursday 27 November 2025 09:45:44 +0000 (0:00:01.779) 0:02:52.523 ***** changed: [instance -> controller-0.instance] TASK [Check if new ssh keypair exists] ***************************************** Thursday 27 November 2025 09:45:45 +0000 (0:00:01.370) 0:02:53.894 ***** TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Thursday 27 November 2025 09:45:45 +0000 (0:00:00.056) 0:02:53.950 ***** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Thursday 27 November 2025 09:45:46 +0000 (0:00:00.257) 0:02:54.208 ***** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Thursday 27 November 2025 09:45:46 +0000 (0:00:00.039) 0:02:54.247 ***** skipping: [instance] TASK [Push ssh jumper/configuration for crc-0] ********************************* Thursday 27 November 2025 09:45:46 +0000 (0:00:00.045) 0:02:54.293 ***** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Thursday 27 November 2025 09:45:46 +0000 (0:00:00.055) 0:02:54.348 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Thursday 27 November 2025 09:45:46 +0000 (0:00:00.102) 0:02:54.450 ***** ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Thursday 27 November 2025 09:45:46 +0000 (0:00:00.236) 0:02:54.687 ***** ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** Thursday 27 November 2025 09:45:46 +0000 (0:00:00.243) 0:02:54.931 ***** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** Thursday 27 November 2025 09:45:47 +0000 (0:00:00.460) 0:02:55.391 ***** changed: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Thursday 27 November 2025 09:45:48 +0000 (0:00:01.050) 0:02:56.442 ***** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* Thursday 27 November 2025 09:45:48 +0000 (0:00:00.045) 0:02:56.487 ***** skipping: [instance] TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** Thursday 27 November 2025 09:45:48 +0000 (0:00:00.065) 0:02:56.553 ***** skipping: [instance] TASK [Create VBMC entity] ****************************************************** Thursday 27 November 2025 09:45:48 +0000 (0:00:00.058) 0:02:56.611 ***** skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) skipping: [instance] TASK [libvirt_manager : List running virtual machines.] ************************ Thursday 27 November 2025 09:45:48 +0000 (0:00:00.055) 0:02:56.667 ***** ok: [instance] TASK [libvirt_manager : Dump UUIDs] ******************************************** Thursday 27 November 2025 09:45:48 +0000 (0:00:00.257) 0:02:56.924 ***** changed: [instance] TASK [Ensure fresh vbmc listing] *********************************************** Thursday 27 November 2025 09:45:49 +0000 (0:00:00.395) 0:02:57.320 ***** skipping: [instance] TASK [libvirt_manager : Update vbmc related fact] ****************************** Thursday 27 November 2025 09:45:49 +0000 (0:00:00.043) 0:02:57.363 ***** skipping: [instance] TASK [libvirt_manager : Dump vbmc known hosts] ********************************* Thursday 27 November 2025 09:45:49 +0000 (0:00:00.041) 0:02:57.404 ***** skipping: [instance] TASK [libvirt_manager : Copy authorized_keys] ********************************** Thursday 27 November 2025 09:45:49 +0000 (0:00:00.043) 0:02:57.448 ***** changed: [instance] TASK [libvirt_manager : Enable root access on CRC] ***************************** Thursday 27 November 2025 09:45:50 +0000 (0:00:00.722) 0:02:58.170 ***** changed: [instance] TASK [reproducer : Get deployed VM group inventories] ************************** Thursday 27 November 2025 09:45:50 +0000 (0:00:00.754) 0:02:58.925 ***** skipping: [instance] TASK [reproducer : Inject remote inventories onto main hypervisor] ************* Thursday 27 November 2025 09:45:50 +0000 (0:00:00.057) 0:02:58.982 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) TASK [reproducer : Gather inventories from instance] *************************** Thursday 27 November 2025 09:45:50 +0000 (0:00:00.075) 0:02:59.058 ***** skipping: [instance] TASK [reproducer : Gather inventories from compute-0] ************************** Thursday 27 November 2025 09:45:51 +0000 (0:00:00.057) 0:02:59.115 ***** skipping: [instance] TASK [reproducer : Gather inventories from controller-0] *********************** Thursday 27 November 2025 09:45:51 +0000 (0:00:00.046) 0:02:59.161 ***** skipping: [instance] TASK [reproducer : Gather inventories from crc-0] ****************************** Thursday 27 November 2025 09:45:51 +0000 (0:00:00.049) 0:02:59.211 ***** skipping: [instance] TASK [reproducer : Push generated inventory from hypervisor] ******************* Thursday 27 November 2025 09:45:51 +0000 (0:00:00.039) 0:02:59.250 ***** changed: [instance] TASK [reproducer : Slurp devscripts private key] ******************************* Thursday 27 November 2025 09:45:51 +0000 (0:00:00.686) 0:02:59.937 ***** skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** Thursday 27 November 2025 09:45:51 +0000 (0:00:00.047) 0:02:59.985 ***** skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* Thursday 27 November 2025 09:45:51 +0000 (0:00:00.042) 0:03:00.027 ***** skipping: [instance] TASK [openshift_login : Assert we have needed parameters] ********************** Thursday 27 November 2025 09:45:52 +0000 (0:00:00.043) 0:03:00.071 ***** skipping: [instance] TASK [openshift_login : Stat kubeconfig] *************************************** Thursday 27 November 2025 09:45:52 +0000 (0:00:00.040) 0:03:00.112 ***** skipping: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Thursday 27 November 2025 09:45:52 +0000 (0:00:00.045) 0:03:00.157 ***** skipping: [instance] TASK [openshift_login : Assert files exist] ************************************ Thursday 27 November 2025 09:45:52 +0000 (0:00:00.042) 0:03:00.200 ***** skipping: [instance] TASK [openshift_login : Gather the password of the deployed cluster.] ********** Thursday 27 November 2025 09:45:52 +0000 (0:00:00.042) 0:03:00.242 ***** skipping: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Thursday 27 November 2025 09:45:52 +0000 (0:00:00.042) 0:03:00.285 ***** skipping: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Thursday 27 November 2025 09:45:52 +0000 (0:00:00.049) 0:03:00.334 ***** skipping: [instance] TASK [reproducer : Set fact for later wait on OCP cluster] ********************* Thursday 27 November 2025 09:45:52 +0000 (0:00:00.053) 0:03:00.387 ***** skipping: [instance] TASK [reproducer : Configure Controller node] ********************************** Thursday 27 November 2025 09:45:52 +0000 (0:00:00.039) 0:03:00.427 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance TASK [reproducer : Ensure directories exist] *********************************** Thursday 27 November 2025 09:45:52 +0000 (0:00:00.244) 0:03:00.671 ***** changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Tweak dnf configuration] ************************************ Thursday 27 November 2025 09:45:53 +0000 (0:00:01.396) 0:03:02.067 ***** skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Thursday 27 November 2025 09:45:54 +0000 (0:00:00.030) 0:03:02.098 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Thursday 27 November 2025 09:45:54 +0000 (0:00:00.682) 0:03:02.781 ***** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Thursday 27 November 2025 09:45:54 +0000 (0:00:00.039) 0:03:02.820 ***** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Thursday 27 November 2025 09:45:54 +0000 (0:00:00.041) 0:03:02.862 ***** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Thursday 27 November 2025 09:45:54 +0000 (0:00:00.036) 0:03:02.898 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get rhos-release] ******************************************* Thursday 27 November 2025 09:45:56 +0000 (0:00:01.622) 0:03:04.520 ***** skipping: [instance] TASK [reproducer : Install repos] ********************************************** Thursday 27 November 2025 09:45:56 +0000 (0:00:00.041) 0:03:04.562 ***** skipping: [instance] TASK [reproducer : Run custom commands after rhos-release setup] *************** Thursday 27 November 2025 09:45:56 +0000 (0:00:00.039) 0:03:04.601 ***** skipping: [instance] TASK [reproducer : Create bundle for CRC] ************************************** Thursday 27 November 2025 09:45:56 +0000 (0:00:00.042) 0:03:04.643 ***** skipping: [instance] TASK [reproducer : Install some tools] ***************************************** Thursday 27 November 2025 09:45:56 +0000 (0:00:00.039) 0:03:04.683 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject command aliases for faster debugging] **************** Thursday 27 November 2025 09:45:57 +0000 (0:00:01.177) 0:03:05.861 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Build job inventory for hook usage] ************************* Thursday 27 November 2025 09:45:58 +0000 (0:00:01.151) 0:03:07.012 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Push the MAC mapping data] ********************************** Thursday 27 November 2025 09:45:59 +0000 (0:00:00.670) 0:03:07.682 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject other Hypervisor SSH keys] *************************** Thursday 27 November 2025 09:46:00 +0000 (0:00:00.991) 0:03:08.674 ***** changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** Thursday 27 November 2025 09:46:01 +0000 (0:00:01.211) 0:03:09.885 ***** changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject SSH configuration] *********************************** Thursday 27 November 2025 09:46:02 +0000 (0:00:00.683) 0:03:10.569 ***** skipping: [instance] => (item=instance) changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) TASK [reproducer : Create kube directory] ************************************** Thursday 27 November 2025 09:46:04 +0000 (0:00:01.802) 0:03:12.372 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeconfig content] ********************************** Thursday 27 November 2025 09:46:04 +0000 (0:00:00.636) 0:03:13.008 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeadmin-password if exists] ************************ Thursday 27 November 2025 09:46:06 +0000 (0:00:01.105) 0:03:14.113 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject devscripts private key if set] *********************** Thursday 27 November 2025 09:46:07 +0000 (0:00:01.080) 0:03:15.194 ***** skipping: [instance] TASK [reproducer : Ensure /etc/ci/env is created] ****************************** Thursday 27 November 2025 09:46:07 +0000 (0:00:00.044) 0:03:15.238 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Ensure directory tree exist] **************************** Thursday 27 November 2025 09:46:07 +0000 (0:00:00.642) 0:03:15.881 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Assert we get needed data] ****************************** Thursday 27 November 2025 09:46:08 +0000 (0:00:00.672) 0:03:16.553 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Push reproducer secrets] ******************************** Thursday 27 November 2025 09:46:08 +0000 (0:00:00.048) 0:03:16.602 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) TASK [manage_secrets : Debug _secret_dest] ************************************* Thursday 27 November 2025 09:46:08 +0000 (0:00:00.081) 0:03:16.684 ***** ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt TASK [manage_secrets : Debug _secret_file] ************************************* Thursday 27 November 2025 09:46:08 +0000 (0:00:00.059) 0:03:16.744 ***** ok: [instance -> controller-0(controller-0.instance)] => _secret_file: '' TASK [manage_secrets : Debug _secret_content] ********************************** Thursday 27 November 2025 09:46:08 +0000 (0:00:00.049) 0:03:16.793 ***** ok: [instance -> controller-0(controller-0.instance)] => _secret_content: my-default-location-place TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Thursday 27 November 2025 09:46:08 +0000 (0:00:00.061) 0:03:16.855 ***** skipping: [instance] TASK [manage_secrets : Check if pull secret src file exists] ******************* Thursday 27 November 2025 09:46:08 +0000 (0:00:00.059) 0:03:16.915 ***** skipping: [instance] TASK [manage_secrets : Copy file to location] ********************************** Thursday 27 November 2025 09:46:08 +0000 (0:00:00.056) 0:03:16.971 ***** skipping: [instance] TASK [manage_secrets : Create file from content] ******************************* Thursday 27 November 2025 09:46:08 +0000 (0:00:00.050) 0:03:17.021 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Debug _secret_dest] ************************************* Thursday 27 November 2025 09:46:10 +0000 (0:00:01.081) 0:03:18.102 ***** ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ipmi-things TASK [manage_secrets : Debug _secret_file] ************************************* Thursday 27 November 2025 09:46:10 +0000 (0:00:00.063) 0:03:18.166 ***** ok: [instance -> controller-0(controller-0.instance)] => _secret_file: /tmp/ipmi-things TASK [manage_secrets : Debug _secret_content] ********************************** Thursday 27 November 2025 09:46:10 +0000 (0:00:00.056) 0:03:18.223 ***** ok: [instance -> controller-0(controller-0.instance)] => _secret_content: '' TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Thursday 27 November 2025 09:46:10 +0000 (0:00:00.057) 0:03:18.280 ***** ok: [instance -> controller-0(controller-0.instance)] => changed=false msg: All assertions passed TASK [manage_secrets : Check if pull secret src file exists] ******************* Thursday 27 November 2025 09:46:10 +0000 (0:00:00.067) 0:03:18.348 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Copy file to location] ********************************** Thursday 27 November 2025 09:46:10 +0000 (0:00:00.694) 0:03:19.042 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Create file from content] ******************************* Thursday 27 November 2025 09:46:12 +0000 (0:00:01.187) 0:03:20.230 ***** skipping: [instance] TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** Thursday 27 November 2025 09:46:12 +0000 (0:00:00.066) 0:03:20.297 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check if async file is still available] ********************* Thursday 27 November 2025 09:46:12 +0000 (0:00:00.660) 0:03:20.957 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check package install status] ******************************* Thursday 27 November 2025 09:46:13 +0000 (0:00:00.742) 0:03:21.700 ***** FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (89 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** Thursday 27 November 2025 09:47:20 +0000 (0:01:07.292) 0:04:28.992 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Install required packages] ****************************** Thursday 27 November 2025 09:47:21 +0000 (0:00:00.590) 0:04:29.583 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get ingresses domain] *********************************** Thursday 27 November 2025 09:47:23 +0000 (0:00:02.476) 0:04:32.060 ***** skipping: [instance] TASK [sushy_emulator : Set sushy url for ocp installation] ********************* Thursday 27 November 2025 09:47:24 +0000 (0:00:00.047) 0:04:32.108 ***** skipping: [instance] TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** Thursday 27 November 2025 09:47:24 +0000 (0:00:00.046) 0:04:32.154 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp private ssh key for later use] ******************** Thursday 27 November 2025 09:47:24 +0000 (0:00:00.741) 0:04:32.896 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* Thursday 27 November 2025 09:47:25 +0000 (0:00:00.668) 0:04:33.564 ***** changed: [instance] TASK [sushy_emulator : Run ssh-keyscan] **************************************** Thursday 27 November 2025 09:47:25 +0000 (0:00:00.326) 0:04:33.891 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write known hosts for later use] ************************ Thursday 27 November 2025 09:47:26 +0000 (0:00:00.757) 0:04:34.648 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Thursday 27 November 2025 09:47:27 +0000 (0:00:01.160) 0:04:35.809 ***** skipping: [instance] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Thursday 27 November 2025 09:47:27 +0000 (0:00:00.045) 0:04:35.855 ***** skipping: [instance] TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Thursday 27 November 2025 09:47:27 +0000 (0:00:00.052) 0:04:35.907 ***** skipping: [instance] TASK [sushy_emulator : Generate list of filtered VMs] ************************** Thursday 27 November 2025 09:47:27 +0000 (0:00:00.036) 0:04:35.943 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** Thursday 27 November 2025 09:47:27 +0000 (0:00:00.059) 0:04:36.003 ***** skipping: [instance] TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** Thursday 27 November 2025 09:47:27 +0000 (0:00:00.040) 0:04:36.043 ***** skipping: [instance] TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** Thursday 27 November 2025 09:47:28 +0000 (0:00:00.040) 0:04:36.084 ***** skipping: [instance] TASK [sushy_emulator : Generate htpasswd string] ******************************* Thursday 27 November 2025 09:47:28 +0000 (0:00:00.043) 0:04:36.127 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write sushy emulator resource loop] ********************* Thursday 27 November 2025 09:47:28 +0000 (0:00:00.667) 0:04:36.794 ***** skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=pod) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Write sushy emulator config] **************************** Thursday 27 November 2025 09:47:28 +0000 (0:00:00.097) 0:04:36.892 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write htpasswd string to file] ************************** Thursday 27 November 2025 09:47:30 +0000 (0:00:01.192) 0:04:38.084 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** Thursday 27 November 2025 09:47:31 +0000 (0:00:01.093) 0:04:39.178 ***** skipping: [instance] TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** Thursday 27 November 2025 09:47:31 +0000 (0:00:00.047) 0:04:39.226 ***** skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* Thursday 27 November 2025 09:47:31 +0000 (0:00:00.045) 0:04:39.272 ***** skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** Thursday 27 November 2025 09:47:31 +0000 (0:00:00.079) 0:04:39.351 ***** skipping: [instance] TASK [podman : Ensure podman is installed] ************************************* Thursday 27 November 2025 09:47:31 +0000 (0:00:00.047) 0:04:39.398 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [podman : Enable loginctl linger for ansible_user_id] ********************* Thursday 27 November 2025 09:47:32 +0000 (0:00:01.608) 0:04:41.007 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* Thursday 27 November 2025 09:47:33 +0000 (0:00:00.812) 0:04:41.819 ***** skipping: [instance] TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* Thursday 27 November 2025 09:47:33 +0000 (0:00:00.135) 0:04:41.955 ***** skipping: [instance] TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** Thursday 27 November 2025 09:47:33 +0000 (0:00:00.042) 0:04:41.997 ***** skipping: [instance] TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** Thursday 27 November 2025 09:47:33 +0000 (0:00:00.055) 0:04:42.052 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create and start Sushy Emulator container] ************** Thursday 27 November 2025 09:47:45 +0000 (0:00:11.598) 0:04:53.651 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure directories exist] *********************************** Thursday 27 November 2025 09:47:47 +0000 (0:00:01.706) 0:04:55.358 ***** ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Convert VBMC list into a dict for better usage] ************* Thursday 27 November 2025 09:47:48 +0000 (0:00:01.255) 0:04:56.613 ***** skipping: [instance] TASK [reproducer : Check if baremetal-info.yml exists] ************************* Thursday 27 November 2025 09:47:48 +0000 (0:00:00.047) 0:04:56.660 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get content of baremetal-info file] ************************* Thursday 27 November 2025 09:47:49 +0000 (0:00:00.656) 0:04:57.317 ***** skipping: [instance] TASK [reproducer : Interpret remote file content as yaml] ********************** Thursday 27 November 2025 09:47:49 +0000 (0:00:00.044) 0:04:57.362 ***** skipping: [instance] TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Thursday 27 November 2025 09:47:49 +0000 (0:00:00.059) 0:04:57.421 ***** skipping: [instance] TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Thursday 27 November 2025 09:47:49 +0000 (0:00:00.050) 0:04:57.471 ***** skipping: [instance] TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** Thursday 27 November 2025 09:47:49 +0000 (0:00:00.042) 0:04:57.514 ***** ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '5fed9f9c-75c8-420e-a0e6-7814265a94ad'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': 'c2007929-5f56-4238-af14-4e7b76ef2fb4'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '63273350-2384-4399-b74e-fd3bfe2b3b2a'}) TASK [reproducer : Output baremetal info file] ********************************* Thursday 27 November 2025 09:47:49 +0000 (0:00:00.144) 0:04:57.659 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Output ironic_nodes to file] ******************************** Thursday 27 November 2025 09:47:50 +0000 (0:00:01.100) 0:04:58.760 ***** skipping: [instance] TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* Thursday 27 November 2025 09:47:50 +0000 (0:00:00.047) 0:04:58.807 ***** TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** Thursday 27 November 2025 09:47:50 +0000 (0:00:00.158) 0:04:58.966 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Thursday 27 November 2025 09:47:50 +0000 (0:00:00.062) 0:04:59.029 ***** skipping: [instance] TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Thursday 27 November 2025 09:47:51 +0000 (0:00:00.055) 0:04:59.085 ***** skipping: [instance] TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** Thursday 27 November 2025 09:47:51 +0000 (0:00:00.047) 0:04:59.132 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** Thursday 27 November 2025 09:47:52 +0000 (0:00:01.499) 0:05:00.631 ***** ok: [instance -> controller-0(controller-0.instance)] => (item=5fed9f9c-75c8-420e-a0e6-7814265a94ad) ok: [instance -> controller-0(controller-0.instance)] => (item=c2007929-5f56-4238-af14-4e7b76ef2fb4) ok: [instance -> controller-0(controller-0.instance)] => (item=63273350-2384-4399-b74e-fd3bfe2b3b2a) TASK [sushy_emulator : Verify baremetal VM power status] *********************** Thursday 27 November 2025 09:47:57 +0000 (0:00:05.156) 0:05:05.788 ***** ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** Thursday 27 November 2025 09:47:57 +0000 (0:00:00.110) 0:05:05.899 ***** ok: [instance -> localhost] TASK [reproducer : Sync local repositories to other hosts if present] ********** Thursday 27 November 2025 09:47:58 +0000 (0:00:00.248) 0:05:06.147 ***** changed: [instance -> localhost] => (item=controller-0) TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** Thursday 27 November 2025 09:48:00 +0000 (0:00:02.290) 0:05:08.438 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install ansible dependencies] ******************************* Thursday 27 November 2025 09:48:01 +0000 (0:00:00.711) 0:05:09.150 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** Thursday 27 November 2025 09:48:01 +0000 (0:00:00.905) 0:05:10.055 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** Thursday 27 November 2025 09:48:03 +0000 (0:00:01.220) 0:05:11.276 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject local environment parameters] ************************ Thursday 27 November 2025 09:48:03 +0000 (0:00:00.761) 0:05:12.038 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create openshift-environment.yml symlink to old location] *** Thursday 27 November 2025 09:48:05 +0000 (0:00:01.160) 0:05:13.198 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get interfaces-info content] ******************************** Thursday 27 November 2025 09:48:05 +0000 (0:00:00.707) 0:05:13.905 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Wait for OCP nodes to be ready] ***************************** Thursday 27 November 2025 09:48:06 +0000 (0:00:00.653) 0:05:14.559 ***** ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) TASK [networking_mapper : Check for Networking Definition file existence] ****** Thursday 27 November 2025 09:48:07 +0000 (0:00:01.479) 0:05:16.039 ***** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Thursday 27 November 2025 09:48:08 +0000 (0:00:00.041) 0:05:16.081 ***** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Thursday 27 November 2025 09:48:08 +0000 (0:00:00.038) 0:05:16.120 ***** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Thursday 27 November 2025 09:48:08 +0000 (0:00:00.045) 0:05:16.165 ***** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Thursday 27 November 2025 09:48:08 +0000 (0:00:00.048) 0:05:16.214 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Thursday 27 November 2025 09:48:08 +0000 (0:00:00.045) 0:05:16.260 ***** ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) ok: [instance -> controller-0(controller-0.instance)] => (item={}) TASK [networking_mapper : Gather facts if requested] *************************** Thursday 27 November 2025 09:48:08 +0000 (0:00:00.114) 0:05:16.375 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance TASK [networking_mapper : Gather the facts] ************************************ Thursday 27 November 2025 09:48:08 +0000 (0:00:00.059) 0:05:16.434 ***** ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** Thursday 27 November 2025 09:48:12 +0000 (0:00:03.693) 0:05:20.128 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Thursday 27 November 2025 09:48:13 +0000 (0:00:01.154) 0:05:21.282 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Definition to file] ************* Thursday 27 November 2025 09:48:13 +0000 (0:00:00.511) 0:05:21.793 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Call the networking mapper] ************************** Thursday 27 November 2025 09:48:14 +0000 (0:00:01.043) 0:05:22.837 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set networking mapper facts] ************************* Thursday 27 November 2025 09:48:14 +0000 (0:00:00.095) 0:05:22.933 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Thursday 27 November 2025 09:48:14 +0000 (0:00:00.065) 0:05:22.998 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CRC ssh key] ***************************************** Thursday 27 November 2025 09:48:15 +0000 (0:00:01.055) 0:05:24.054 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure we have all dependencies installed] ****************** Thursday 27 November 2025 09:48:16 +0000 (0:00:00.948) 0:05:25.002 ***** FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [Configure ntp service] *************************************************** Thursday 27 November 2025 09:48:22 +0000 (0:00:06.065) 0:05:31.068 ***** TASK [cifmw_ntp : Install chrony] ********************************************** Thursday 27 November 2025 09:48:23 +0000 (0:00:00.205) 0:05:31.273 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Configure original chrony.conf file] ************************* Thursday 27 November 2025 09:48:24 +0000 (0:00:01.035) 0:05:32.308 ***** ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) TASK [cifmw_ntp : Render chrony extra config file] ***************************** Thursday 27 November 2025 09:48:25 +0000 (0:00:01.108) 0:05:33.417 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Enable chrony service] *************************************** Thursday 27 November 2025 09:48:26 +0000 (0:00:01.001) 0:05:34.419 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Configure CRC node if available] **************************** Thursday 27 November 2025 09:48:27 +0000 (0:00:00.678) 0:05:35.098 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance TASK [reproducer : Get the networking-environment-definition from controller-0] *** Thursday 27 November 2025 09:48:27 +0000 (0:00:00.168) 0:05:35.266 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check which dnsmasq config we must edit] ******************** Thursday 27 November 2025 09:48:27 +0000 (0:00:00.569) 0:05:35.835 ***** ok: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Configure local DNS for CRC pod] **************************** Thursday 27 November 2025 09:48:28 +0000 (0:00:00.606) 0:05:36.441 ***** changed: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** Thursday 27 November 2025 09:48:29 +0000 (0:00:00.757) 0:05:37.199 ***** changed: [instance -> crc-0(crc-0.instance)] TASK [Restart DNS in CRC VM] *************************************************** Thursday 27 November 2025 09:48:29 +0000 (0:00:00.559) 0:05:37.758 ***** TASK [openshift_setup : Check which dnsmasq config we must edit] *************** Thursday 27 November 2025 09:48:29 +0000 (0:00:00.051) 0:05:37.810 ***** ok: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Restart dnsmasq service if used] *********************** Thursday 27 November 2025 09:48:30 +0000 (0:00:00.549) 0:05:38.359 ***** changed: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Stop dnsmasq] ****************************************** Thursday 27 November 2025 09:48:31 +0000 (0:00:00.764) 0:05:39.124 ***** skipping: [instance] TASK [openshift_setup : Start dnsmasq] ***************************************** Thursday 27 November 2025 09:48:31 +0000 (0:00:00.040) 0:05:39.164 ***** skipping: [instance] TASK [reproducer : Remove entry from /etc/hosts] ******************************* Thursday 27 November 2025 09:48:31 +0000 (0:00:00.043) 0:05:39.207 ***** changed: [instance] TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** Thursday 27 November 2025 09:48:31 +0000 (0:00:00.273) 0:05:39.481 ***** skipping: [instance] => (item=) TASK [dnsmasq : Assert we have needed address data] **************************** Thursday 27 November 2025 09:48:31 +0000 (0:00:00.165) 0:05:39.647 ***** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Thursday 27 November 2025 09:48:31 +0000 (0:00:00.050) 0:05:39.697 ***** ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Thursday 27 November 2025 09:48:31 +0000 (0:00:00.076) 0:05:39.773 ***** changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ Thursday 27 November 2025 09:48:32 +0000 (0:00:00.355) 0:05:40.129 ***** TASK [dnsmasq : Assert we have needed host record data] ************************ Thursday 27 November 2025 09:48:32 +0000 (0:00:00.050) 0:05:40.180 ***** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Thursday 27 November 2025 09:48:32 +0000 (0:00:00.080) 0:05:40.260 ***** ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Thursday 27 November 2025 09:48:32 +0000 (0:00:00.080) 0:05:40.341 ***** changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [reproducer : Ensure "testing" domain is "local"] ************************* Thursday 27 November 2025 09:48:32 +0000 (0:00:00.289) 0:05:40.630 ***** changed: [instance] TASK [reproducer : Flush handlers] ********************************************* Thursday 27 November 2025 09:48:33 +0000 (0:00:00.440) 0:05:41.071 ***** RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** Thursday 27 November 2025 09:48:33 +0000 (0:00:00.011) 0:05:41.083 ***** changed: [instance -> controller-0(controller-0.instance)] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Thursday 27 November 2025 09:48:33 +0000 (0:00:00.804) 0:05:41.887 ***** changed: [instance] TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** Thursday 27 November 2025 09:48:34 +0000 (0:00:00.440) 0:05:42.328 ***** skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** Thursday 27 November 2025 09:48:34 +0000 (0:00:00.184) 0:05:42.512 ***** changed: [instance -> compute-0(compute-0.instance)] TASK [reproducer : Tweak dnf configuration] ************************************ Thursday 27 November 2025 09:48:36 +0000 (0:00:01.559) 0:05:44.072 ***** skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Thursday 27 November 2025 09:48:36 +0000 (0:00:00.031) 0:05:44.103 ***** ok: [instance -> compute-0(compute-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Thursday 27 November 2025 09:48:36 +0000 (0:00:00.542) 0:05:44.645 ***** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Thursday 27 November 2025 09:48:36 +0000 (0:00:00.057) 0:05:44.703 ***** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Thursday 27 November 2025 09:48:36 +0000 (0:00:00.036) 0:05:44.739 ***** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Thursday 27 November 2025 09:48:36 +0000 (0:00:00.035) 0:05:44.775 ***** changed: [instance -> compute-0(compute-0.instance)] TASK [reproducer : Get rhos-release and setup repos] *************************** Thursday 27 November 2025 09:48:38 +0000 (0:00:01.559) 0:05:46.335 ***** skipping: [instance] TASK [reproducer : Create repositories on computes] **************************** Thursday 27 November 2025 09:48:38 +0000 (0:00:00.045) 0:05:46.381 ***** skipping: [instance] TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* Thursday 27 November 2025 09:48:38 +0000 (0:00:00.026) 0:05:46.407 ***** skipping: [instance] TASK [reproducer : Discover and expose CI Framework path on remote node] ******* Thursday 27 November 2025 09:48:38 +0000 (0:00:00.035) 0:05:46.442 ***** ok: [instance] TASK [reproducer : Push local code] ******************************************** Thursday 27 November 2025 09:48:38 +0000 (0:00:00.064) 0:05:46.507 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance TASK [reproducer : Check if repository directories already exist] ************** Thursday 27 November 2025 09:48:38 +0000 (0:00:00.110) 0:05:46.617 ***** skipping: [instance] TASK [reproducer : Ensure we are not in the job_id branch] ********************* Thursday 27 November 2025 09:48:38 +0000 (0:00:00.050) 0:05:46.668 ***** skipping: [instance] TASK [reproducer : Fetch zuul.items repositories] ****************************** Thursday 27 November 2025 09:48:38 +0000 (0:00:00.052) 0:05:46.720 ***** skipping: [instance] TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** Thursday 27 November 2025 09:48:38 +0000 (0:00:00.048) 0:05:46.769 ***** skipping: [instance] TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** Thursday 27 November 2025 09:48:38 +0000 (0:00:00.057) 0:05:46.827 ***** skipping: [instance] TASK [reproducer : Create target directories beforehand] *********************** Thursday 27 November 2025 09:48:38 +0000 (0:00:00.037) 0:05:46.864 ***** ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) TASK [reproducer : Sync local repositories to ansible controller] ************** Thursday 27 November 2025 09:48:39 +0000 (0:00:00.496) 0:05:47.361 ***** ok: [instance -> localhost] => (item=ci-framework) TASK [reproducer : Sync remote repositories] *********************************** Thursday 27 November 2025 09:48:39 +0000 (0:00:00.618) 0:05:47.980 ***** skipping: [instance] => (item=ci-framework) skipping: [instance] TASK [reproducer : Ensure default repositories are present] ******************** Thursday 27 November 2025 09:48:39 +0000 (0:00:00.048) 0:05:48.028 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) TASK [reproducer : Check repository availability: ci-framework] **************** Thursday 27 November 2025 09:48:40 +0000 (0:00:00.083) 0:05:48.112 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: ci-framework] ******************* Thursday 27 November 2025 09:48:40 +0000 (0:00:00.541) 0:05:48.653 ***** skipping: [instance] TASK [reproducer : Check repository availability: install_yamls] *************** Thursday 27 November 2025 09:48:40 +0000 (0:00:00.049) 0:05:48.703 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: install_yamls] ****************** Thursday 27 November 2025 09:48:41 +0000 (0:00:00.539) 0:05:49.242 ***** skipping: [instance] TASK [reproducer : Check repository availability: architecture] **************** Thursday 27 November 2025 09:48:41 +0000 (0:00:00.048) 0:05:49.290 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: architecture] ******************* Thursday 27 November 2025 09:48:41 +0000 (0:00:00.510) 0:05:49.801 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install collections on controller-0] ************************ Thursday 27 November 2025 09:48:44 +0000 (0:00:02.308) 0:05:52.110 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CI Framework motd] *********************************** Thursday 27 November 2025 09:49:03 +0000 (0:00:19.463) 0:06:11.573 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate some logs] ******************************************* Thursday 27 November 2025 09:49:04 +0000 (0:00:01.115) 0:06:12.689 ***** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* Thursday 27 November 2025 09:49:04 +0000 (0:00:00.122) 0:06:12.812 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate log if present] ************************************** Thursday 27 November 2025 09:49:05 +0000 (0:00:00.544) 0:06:13.356 ***** skipping: [instance] TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** Thursday 27 November 2025 09:49:05 +0000 (0:00:00.041) 0:06:13.398 ***** skipping: [instance] TASK [cifmw_setup : Get customized parameters] ********************************* Thursday 27 November 2025 09:49:05 +0000 (0:00:00.047) 0:06:13.445 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Ensure target directory exists] ***************************** Thursday 27 November 2025 09:49:05 +0000 (0:00:00.150) 0:06:13.596 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Thursday 27 November 2025 09:49:06 +0000 (0:00:00.562) 0:06:14.158 ***** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Thursday 27 November 2025 09:49:06 +0000 (0:00:00.041) 0:06:14.199 ***** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Thursday 27 November 2025 09:49:06 +0000 (0:00:00.107) 0:06:14.307 ***** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Thursday 27 November 2025 09:49:06 +0000 (0:00:00.045) 0:06:14.352 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Ensure directories are present] ***************************** Thursday 27 November 2025 09:49:07 +0000 (0:00:01.618) 0:06:15.971 ***** changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [repo_setup : Make sure git-core package is installed] ******************** Thursday 27 November 2025 09:49:09 +0000 (0:00:01.570) 0:06:17.541 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Get repo-setup repository] ********************************** Thursday 27 November 2025 09:49:10 +0000 (0:00:01.045) 0:06:18.587 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Initialize python venv and install requirements] ************ Thursday 27 November 2025 09:49:11 +0000 (0:00:01.389) 0:06:19.976 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Install repo-setup package] ********************************* Thursday 27 November 2025 09:49:19 +0000 (0:00:08.037) 0:06:28.014 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Thursday 27 November 2025 09:49:21 +0000 (0:00:01.062) 0:06:29.076 ***** skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Thursday 27 November 2025 09:49:21 +0000 (0:00:00.050) 0:06:29.127 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Get component repo] ***************************************** Thursday 27 November 2025 09:49:22 +0000 (0:00:01.235) 0:06:30.363 ***** skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Thursday 27 November 2025 09:49:22 +0000 (0:00:00.060) 0:06:30.423 ***** skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Thursday 27 November 2025 09:49:22 +0000 (0:00:00.067) 0:06:30.491 ***** skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Thursday 27 November 2025 09:49:22 +0000 (0:00:00.065) 0:06:30.557 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Thursday 27 November 2025 09:49:23 +0000 (0:00:01.041) 0:06:31.598 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Dump current-podified hash] ********************************* Thursday 27 November 2025 09:49:24 +0000 (0:00:00.999) 0:06:32.597 ***** skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Thursday 27 November 2025 09:49:24 +0000 (0:00:00.048) 0:06:32.646 ***** skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Thursday 27 November 2025 09:49:24 +0000 (0:00:00.046) 0:06:32.692 ***** skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Thursday 27 November 2025 09:49:24 +0000 (0:00:00.047) 0:06:32.739 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Create download directory] ********************************** Thursday 27 November 2025 09:49:24 +0000 (0:00:00.061) 0:06:32.800 ***** skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Thursday 27 November 2025 09:49:24 +0000 (0:00:00.049) 0:06:32.850 ***** skipping: [instance] TASK [Download the RPM] ******************************************************** Thursday 27 November 2025 09:49:24 +0000 (0:00:00.049) 0:06:32.899 ***** skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Thursday 27 November 2025 09:49:24 +0000 (0:00:00.043) 0:06:32.942 ***** skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Thursday 27 November 2025 09:49:24 +0000 (0:00:00.043) 0:06:32.986 ***** skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Thursday 27 November 2025 09:49:24 +0000 (0:00:00.047) 0:06:33.033 ***** skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Thursday 27 November 2025 09:49:25 +0000 (0:00:00.047) 0:06:33.080 ***** skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Thursday 27 November 2025 09:49:25 +0000 (0:00:00.042) 0:06:33.122 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Thursday 27 November 2025 09:49:25 +0000 (0:00:00.512) 0:06:33.635 ***** skipping: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Thursday 27 November 2025 09:49:25 +0000 (0:00:00.064) 0:06:33.699 ***** skipping: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Thursday 27 November 2025 09:49:25 +0000 (0:00:00.063) 0:06:33.763 ***** skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Thursday 27 November 2025 09:49:25 +0000 (0:00:00.048) 0:06:33.811 ***** skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Thursday 27 November 2025 09:49:25 +0000 (0:00:00.065) 0:06:33.876 ***** skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Thursday 27 November 2025 09:49:25 +0000 (0:00:00.062) 0:06:33.939 ***** skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Thursday 27 November 2025 09:49:25 +0000 (0:00:00.063) 0:06:34.002 ***** skipping: [instance] TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** Thursday 27 November 2025 09:49:25 +0000 (0:00:00.062) 0:06:34.065 ***** skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Thursday 27 November 2025 09:49:26 +0000 (0:00:00.070) 0:06:34.136 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Thursday 27 November 2025 09:49:26 +0000 (0:00:00.681) 0:06:34.817 ***** changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [repo_setup : Cleanup existing metadata] ********************************** Thursday 27 November 2025 09:49:27 +0000 (0:00:01.131) 0:06:35.949 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Thursday 27 November 2025 09:49:28 +0000 (0:00:00.757) 0:06:36.707 ***** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Gather variables for each operating system] ******************* Thursday 27 November 2025 09:49:29 +0000 (0:00:00.554) 0:06:37.261 ***** ok: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0] TASK [ci_setup : List packages to install] ************************************* Thursday 27 November 2025 09:49:29 +0000 (0:00:00.073) 0:06:37.334 ***** ok: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Install needed packages] ************************************** Thursday 27 November 2025 09:49:29 +0000 (0:00:00.047) 0:06:37.382 ***** fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result' TASK [Create dnsmasq dir] ****************************************************** Thursday 27 November 2025 09:49:39 +0000 (0:00:10.253) 0:06:47.635 ***** changed: [instance] TASK [Get journalctl in a file] ************************************************ Thursday 27 November 2025 09:49:39 +0000 (0:00:00.228) 0:06:47.864 ***** changed: [instance] TASK [Dump journalctl output] ************************************************** Thursday 27 November 2025 09:49:40 +0000 (0:00:00.256) 0:06:48.121 ***** changed: [instance] TASK [Copy all dnsmasq config] ************************************************* Thursday 27 November 2025 09:49:40 +0000 (0:00:00.436) 0:06:48.557 ***** changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) TASK [Create log directory] **************************************************** Thursday 27 November 2025 09:49:41 +0000 (0:00:00.537) 0:06:49.095 ***** changed: [instance] TASK [Sync logs from controller-0] ********************************************* Thursday 27 November 2025 09:49:41 +0000 (0:00:00.233) 0:06:49.328 ***** changed: [instance] PLAY RECAP ********************************************************************* instance : ok=505 changed=190 unreachable=0 failed=1 skipped=205 rescued=0 ignored=0 Thursday 27 November 2025 09:49:42 +0000 (0:00:00.896) 0:06:50.224 ***** =============================================================================== reproducer : Check package install status ------------------------------ 67.29s libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.08s libvirt_manager : Download base image ---------------------------------- 21.92s reproducer : Install collections on controller-0 ----------------------- 19.46s libvirt_manager : Install packages required for using KVM -------------- 12.32s sushy_emulator : Pull Sushy Emulator container image ------------------- 11.60s ci_setup : Install needed packages ------------------------------------- 10.25s repo_setup : Initialize python venv and install requirements ------------ 8.04s reproducer : Ensure we have all dependencies installed ------------------ 6.07s sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.16s ci_nmstate : Install required packages on localhost --------------------- 4.92s dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.72s networking_mapper : Gather the facts ------------------------------------ 3.69s dnsmasq : Add/Remove address -------------------------------------------- 3.42s sushy_emulator : Install required packages ------------------------------ 2.48s reproducer : Clone repository if needed: architecture ------------------- 2.31s reproducer : Sync local repositories to other hosts if present ---------- 2.29s dnsmasq : Add DHCP entries ---------------------------------------------- 2.24s libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.08s discover_latest_image : Get latest image -------------------------------- 1.87s