PLAY [Prepare] ***************************************************************** TASK [Gathering Facts] ********************************************************* Wednesday 03 December 2025 10:48:45 +0000 (0:00:00.018) 0:00:00.018 **** ok: [instance] TASK [Create custom basedir] *************************************************** Wednesday 03 December 2025 10:48:45 +0000 (0:00:00.810) 0:00:00.828 **** changed: [instance] TASK [test_deps : Gather facts if they don't exist] **************************** Wednesday 03 December 2025 10:48:46 +0000 (0:00:00.295) 0:00:01.123 **** skipping: [instance] TASK [test_deps : Gather variables for each operating system] ****************** Wednesday 03 December 2025 10:48:46 +0000 (0:00:00.017) 0:00:01.141 **** ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) TASK [test_deps : Detect mirrors file] ***************************************** Wednesday 03 December 2025 10:48:46 +0000 (0:00:00.039) 0:00:01.181 **** ok: [instance] TASK [test_deps : Disable ubi host subscription-manager integration] *********** Wednesday 03 December 2025 10:48:46 +0000 (0:00:00.260) 0:00:01.442 **** ok: [instance] TASK [test_deps : Disable ubi 9 repos] ***************************************** Wednesday 03 December 2025 10:48:46 +0000 (0:00:00.194) 0:00:01.637 **** ok: [instance] => (item=ubi-9-appstream) ok: [instance] => (item=ubi-9-baseos) ok: [instance] => (item=ubi-9-codeready-builder) TASK [Deploy repo-setup] ******************************************************* Wednesday 03 December 2025 10:48:47 +0000 (0:00:00.696) 0:00:02.333 **** TASK [repo_setup : Ensure directories are present] ***************************** Wednesday 03 December 2025 10:48:47 +0000 (0:00:00.057) 0:00:02.391 **** changed: [instance] => (item=tmp) changed: [instance] => (item=artifacts/repositories) changed: [instance] => (item=venv/repo_setup) TASK [repo_setup : Make sure git-core package is installed] ******************** Wednesday 03 December 2025 10:48:47 +0000 (0:00:00.515) 0:00:02.907 **** ok: [instance] TASK [repo_setup : Get repo-setup repository] ********************************** Wednesday 03 December 2025 10:48:48 +0000 (0:00:00.795) 0:00:03.703 **** changed: [instance] TASK [repo_setup : Initialize python venv and install requirements] ************ Wednesday 03 December 2025 10:48:49 +0000 (0:00:01.019) 0:00:04.722 **** changed: [instance] TASK [repo_setup : Install repo-setup package] ********************************* Wednesday 03 December 2025 10:48:57 +0000 (0:00:07.431) 0:00:12.154 **** changed: [instance] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Wednesday 03 December 2025 10:48:57 +0000 (0:00:00.669) 0:00:12.823 **** skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Wednesday 03 December 2025 10:48:57 +0000 (0:00:00.021) 0:00:12.845 **** changed: [instance] TASK [repo_setup : Get component repo] ***************************************** Wednesday 03 December 2025 10:48:58 +0000 (0:00:00.772) 0:00:13.617 **** skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Wednesday 03 December 2025 10:48:58 +0000 (0:00:00.036) 0:00:13.654 **** skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Wednesday 03 December 2025 10:48:58 +0000 (0:00:00.033) 0:00:13.688 **** skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Wednesday 03 December 2025 10:48:58 +0000 (0:00:00.034) 0:00:13.723 **** changed: [instance] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Wednesday 03 December 2025 10:49:00 +0000 (0:00:01.530) 0:00:15.253 **** changed: [instance] TASK [repo_setup : Dump current-podified hash] ********************************* Wednesday 03 December 2025 10:49:00 +0000 (0:00:00.425) 0:00:15.678 **** skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Wednesday 03 December 2025 10:49:00 +0000 (0:00:00.031) 0:00:15.710 **** skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Wednesday 03 December 2025 10:49:00 +0000 (0:00:00.028) 0:00:15.738 **** skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Wednesday 03 December 2025 10:49:00 +0000 (0:00:00.027) 0:00:15.766 **** ok: [instance] TASK [repo_setup : Create download directory] ********************************** Wednesday 03 December 2025 10:49:00 +0000 (0:00:00.035) 0:00:15.802 **** skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Wednesday 03 December 2025 10:49:00 +0000 (0:00:00.027) 0:00:15.829 **** skipping: [instance] TASK [Download the RPM] ******************************************************** Wednesday 03 December 2025 10:49:00 +0000 (0:00:00.026) 0:00:15.855 **** skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Wednesday 03 December 2025 10:49:00 +0000 (0:00:00.026) 0:00:15.882 **** skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Wednesday 03 December 2025 10:49:00 +0000 (0:00:00.026) 0:00:15.908 **** skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Wednesday 03 December 2025 10:49:00 +0000 (0:00:00.027) 0:00:15.936 **** skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.060) 0:00:15.996 **** skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.026) 0:00:16.023 **** ok: [instance] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.181) 0:00:16.204 **** changed: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.208) 0:00:16.413 **** changed: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.216) 0:00:16.629 **** skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.022) 0:00:16.652 **** skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.024) 0:00:16.676 **** skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.021) 0:00:16.698 **** skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.023) 0:00:16.721 **** skipping: [instance] TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.022) 0:00:16.744 **** skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.021) 0:00:16.765 **** skipping: [instance] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.017) 0:00:16.783 **** skipping: [instance] TASK [repo_setup : Cleanup existing metadata] ********************************** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.030) 0:00:16.813 **** skipping: [instance] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.018) 0:00:16.832 **** skipping: [instance] TASK [test_deps : Look for redhat-release rpm] ********************************* Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.023) 0:00:16.855 **** skipping: [instance] TASK [test_deps : Remove redhat-release] *************************************** Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.033) 0:00:16.889 **** skipping: [instance] TASK [test_deps : Install centos-stream-release] ******************************* Wednesday 03 December 2025 10:49:01 +0000 (0:00:00.029) 0:00:16.918 **** skipping: [instance] TASK [test_deps : Install additional packages] ********************************* Wednesday 03 December 2025 10:49:02 +0000 (0:00:00.028) 0:00:16.947 **** skipping: [instance] TASK [test_deps : Install selinux python libs] ********************************* Wednesday 03 December 2025 10:49:02 +0000 (0:00:00.028) 0:00:16.976 **** ok: [instance] TASK [test_deps : Install python yaml libs] ************************************ Wednesday 03 December 2025 10:49:52 +0000 (0:00:50.097) 0:01:07.073 **** ok: [instance] TASK [test_deps : Install extra packages] ************************************** Wednesday 03 December 2025 10:49:53 +0000 (0:00:01.121) 0:01:08.194 **** skipping: [instance] TASK [ci_setup : Gather variables for each operating system] ******************* Wednesday 03 December 2025 10:49:53 +0000 (0:00:00.030) 0:01:08.224 **** ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) TASK [ci_setup : List packages to install] ************************************* Wednesday 03 December 2025 10:49:53 +0000 (0:00:00.040) 0:01:08.265 **** ok: [instance] => cifmw_ci_setup_packages: - bash-completion - ca-certificates - git-core - make - tar - tmux - python3-pip TASK [ci_setup : Install needed packages] ************************************** Wednesday 03 December 2025 10:49:53 +0000 (0:00:00.018) 0:01:08.283 **** changed: [instance] TASK [ci_setup : Gather version of openshift client] *************************** Wednesday 03 December 2025 10:50:01 +0000 (0:00:07.720) 0:01:16.004 **** ok: [instance] TASK [ci_setup : Ensure openshift client install path is present] ************** Wednesday 03 December 2025 10:50:01 +0000 (0:00:00.565) 0:01:16.569 **** changed: [instance] TASK [ci_setup : Install openshift client] ************************************* Wednesday 03 December 2025 10:50:01 +0000 (0:00:00.199) 0:01:16.769 **** changed: [instance] TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** Wednesday 03 December 2025 10:50:07 +0000 (0:00:05.887) 0:01:22.656 **** ok: [instance] TASK [ci_setup : Create completion file] *************************************** Wednesday 03 December 2025 10:50:07 +0000 (0:00:00.035) 0:01:22.691 **** changed: [instance] TASK [ci_setup : Source completion from within .bashrc] ************************ Wednesday 03 December 2025 10:50:08 +0000 (0:00:00.282) 0:01:22.974 **** changed: [instance] TASK [ci_setup : Check rhsm status] ******************************************** Wednesday 03 December 2025 10:50:08 +0000 (0:00:00.268) 0:01:23.242 **** skipping: [instance] TASK [ci_setup : Gather the repos to be enabled] ******************************* Wednesday 03 December 2025 10:50:08 +0000 (0:00:00.017) 0:01:23.260 **** skipping: [instance] TASK [ci_setup : Enabling the required repositories.] ************************** Wednesday 03 December 2025 10:50:08 +0000 (0:00:00.016) 0:01:23.276 **** skipping: [instance] TASK [ci_setup : Get current /etc/redhat-release] ****************************** Wednesday 03 December 2025 10:50:08 +0000 (0:00:00.016) 0:01:23.292 **** skipping: [instance] TASK [ci_setup : Print current /etc/redhat-release] **************************** Wednesday 03 December 2025 10:50:08 +0000 (0:00:00.016) 0:01:23.309 **** skipping: [instance] TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* Wednesday 03 December 2025 10:50:08 +0000 (0:00:00.016) 0:01:23.326 **** skipping: [instance] TASK [ci_setup : Manage directories] ******************************************* Wednesday 03 December 2025 10:50:08 +0000 (0:00:00.020) 0:01:23.346 **** changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) changed: [instance] => (item=/opt/basedir/logs) ok: [instance] => (item=/opt/basedir/tmp) changed: [instance] => (item=/opt/basedir/volumes) changed: [instance] => (item=/opt/basedir/artifacts/parameters) TASK [Create secret file] ****************************************************** Wednesday 03 December 2025 10:50:09 +0000 (0:00:00.948) 0:01:24.295 **** changed: [instance] PLAY RECAP ********************************************************************* instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 Wednesday 03 December 2025 10:50:09 +0000 (0:00:00.314) 0:01:24.610 **** =============================================================================== test_deps : Install selinux python libs -------------------------------- 50.10s ci_setup : Install needed packages -------------------------------------- 7.72s repo_setup : Initialize python venv and install requirements ------------ 7.43s ci_setup : Install openshift client ------------------------------------- 5.89s repo_setup : Run repo-setup-get-hash ------------------------------------ 1.53s test_deps : Install python yaml libs ------------------------------------ 1.12s repo_setup : Get repo-setup repository ---------------------------------- 1.02s ci_setup : Manage directories ------------------------------------------- 0.95s Gathering Facts --------------------------------------------------------- 0.81s repo_setup : Make sure git-core package is installed -------------------- 0.80s repo_setup : Run repo-setup --------------------------------------------- 0.77s test_deps : Disable ubi 9 repos ----------------------------------------- 0.70s repo_setup : Install repo-setup package --------------------------------- 0.67s ci_setup : Gather version of openshift client --------------------------- 0.57s repo_setup : Ensure directories are present ----------------------------- 0.52s repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s Create secret file ------------------------------------------------------ 0.31s Create custom basedir --------------------------------------------------- 0.30s ci_setup : Create completion file --------------------------------------- 0.28s ci_setup : Source completion from within .bashrc ------------------------ 0.27s PLAY [Converge] **************************************************************** TASK [Gathering Facts] ********************************************************* Wednesday 03 December 2025 10:50:10 +0000 (0:00:00.024) 0:00:00.024 **** ok: [instance] TASK [Load networking definition from scenario file] *************************** Wednesday 03 December 2025 10:50:11 +0000 (0:00:00.782) 0:00:00.807 **** ok: [instance] TASK [discover_latest_image : Get latest image] ******************************** Wednesday 03 December 2025 10:50:11 +0000 (0:00:00.023) 0:00:00.830 **** changed: [instance] TASK [discover_latest_image : Export facts accordingly] ************************ Wednesday 03 December 2025 10:50:12 +0000 (0:00:01.632) 0:00:02.462 **** ok: [instance] TASK [reproducer : Load CI job environment] ************************************ Wednesday 03 December 2025 10:50:12 +0000 (0:00:00.025) 0:00:02.488 **** skipping: [instance] TASK [Build final libvirt layout] ********************************************** Wednesday 03 December 2025 10:50:12 +0000 (0:00:00.033) 0:00:02.521 **** TASK [libvirt_manager : Chose right parameter for layout definition] *********** Wednesday 03 December 2025 10:50:12 +0000 (0:00:00.045) 0:00:02.567 **** ok: [instance] TASK [libvirt_manager : Patch the layout if needed] **************************** Wednesday 03 December 2025 10:50:12 +0000 (0:00:00.076) 0:00:02.644 **** skipping: [instance] TASK [reproducer : Assert no conflicting parameters were passed] *************** Wednesday 03 December 2025 10:50:12 +0000 (0:00:00.056) 0:00:02.701 **** ok: [instance] TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** Wednesday 03 December 2025 10:50:12 +0000 (0:00:00.026) 0:00:02.727 **** ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Set _use_crc based on actual layout] ************************ Wednesday 03 December 2025 10:50:12 +0000 (0:00:00.023) 0:00:02.751 **** ok: [instance] TASK [reproducer : Ensure directories are present] ***************************** Wednesday 03 December 2025 10:50:13 +0000 (0:00:00.039) 0:00:02.790 **** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [Bootstrap libvirt if needed] ********************************************* Wednesday 03 December 2025 10:50:13 +0000 (0:00:00.427) 0:00:03.218 **** TASK [libvirt_manager : Ensure output directory exists] ************************ Wednesday 03 December 2025 10:50:13 +0000 (0:00:00.071) 0:00:03.290 **** ok: [instance] TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* Wednesday 03 December 2025 10:50:13 +0000 (0:00:00.185) 0:00:03.476 **** changed: [instance] TASK [libvirt_manager : Check if KVM is enabled] ******************************* Wednesday 03 December 2025 10:50:13 +0000 (0:00:00.246) 0:00:03.722 **** ok: [instance] TASK [libvirt_manager : Fail if KVM not enabled] ******************************* Wednesday 03 December 2025 10:50:14 +0000 (0:00:00.270) 0:00:03.993 **** skipping: [instance] TASK [libvirt_manager : Check if VMX virtualization] *************************** Wednesday 03 December 2025 10:50:14 +0000 (0:00:00.028) 0:00:04.022 **** skipping: [instance] TASK [libvirt_manager : Check if SVM virtualization] *************************** Wednesday 03 December 2025 10:50:14 +0000 (0:00:00.017) 0:00:04.040 **** ok: [instance] TASK [libvirt_manager : Enable VMX virtualization] ***************************** Wednesday 03 December 2025 10:50:14 +0000 (0:00:00.020) 0:00:04.060 **** skipping: [instance] TASK [libvirt_manager : Install packages required for using KVM] *************** Wednesday 03 December 2025 10:50:14 +0000 (0:00:00.028) 0:00:04.088 **** changed: [instance] TASK [libvirt_manager : Create rules.d polkit folder] ************************** Wednesday 03 December 2025 10:50:25 +0000 (0:00:10.833) 0:00:14.922 **** changed: [instance] TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* Wednesday 03 December 2025 10:50:25 +0000 (0:00:00.206) 0:00:15.128 **** changed: [instance] TASK [libvirt_manager : Restart service polkit service] ************************ Wednesday 03 December 2025 10:50:25 +0000 (0:00:00.479) 0:00:15.608 **** changed: [instance] TASK [libvirt_manager : Remove directory for service override] ***************** Wednesday 03 December 2025 10:50:26 +0000 (0:00:00.565) 0:00:16.173 **** ok: [instance] TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** Wednesday 03 December 2025 10:50:26 +0000 (0:00:00.191) 0:00:16.364 **** ok: [instance] TASK [libvirt_manager : Ensure firewalld service is up] ************************ Wednesday 03 December 2025 10:50:27 +0000 (0:00:00.618) 0:00:16.982 **** changed: [instance] TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** Wednesday 03 December 2025 10:50:28 +0000 (0:00:00.873) 0:00:17.856 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* Wednesday 03 December 2025 10:50:28 +0000 (0:00:00.078) 0:00:17.935 **** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** Wednesday 03 December 2025 10:50:28 +0000 (0:00:00.320) 0:00:18.255 **** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** Wednesday 03 December 2025 10:50:28 +0000 (0:00:00.296) 0:00:18.551 **** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** Wednesday 03 December 2025 10:50:29 +0000 (0:00:00.309) 0:00:18.861 **** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** Wednesday 03 December 2025 10:50:29 +0000 (0:00:00.298) 0:00:19.159 **** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* Wednesday 03 December 2025 10:50:29 +0000 (0:00:00.303) 0:00:19.462 **** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** Wednesday 03 December 2025 10:50:30 +0000 (0:00:00.305) 0:00:19.768 **** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* Wednesday 03 December 2025 10:50:30 +0000 (0:00:00.298) 0:00:20.066 **** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** Wednesday 03 December 2025 10:50:30 +0000 (0:00:00.303) 0:00:20.370 **** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** Wednesday 03 December 2025 10:50:30 +0000 (0:00:00.299) 0:00:20.669 **** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* Wednesday 03 December 2025 10:50:31 +0000 (0:00:00.297) 0:00:20.967 **** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** Wednesday 03 December 2025 10:50:31 +0000 (0:00:00.298) 0:00:21.265 **** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** Wednesday 03 December 2025 10:50:31 +0000 (0:00:00.297) 0:00:21.562 **** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** Wednesday 03 December 2025 10:50:32 +0000 (0:00:00.303) 0:00:21.866 **** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** Wednesday 03 December 2025 10:50:32 +0000 (0:00:00.311) 0:00:22.178 **** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* Wednesday 03 December 2025 10:50:32 +0000 (0:00:00.319) 0:00:22.497 **** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** Wednesday 03 December 2025 10:50:33 +0000 (0:00:00.305) 0:00:22.802 **** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ Wednesday 03 December 2025 10:50:33 +0000 (0:00:00.305) 0:00:23.107 **** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** Wednesday 03 December 2025 10:50:33 +0000 (0:00:00.303) 0:00:23.411 **** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* Wednesday 03 December 2025 10:50:33 +0000 (0:00:00.298) 0:00:23.709 **** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** Wednesday 03 December 2025 10:50:34 +0000 (0:00:00.314) 0:00:24.023 **** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** Wednesday 03 December 2025 10:50:34 +0000 (0:00:00.324) 0:00:24.348 **** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* Wednesday 03 December 2025 10:50:34 +0000 (0:00:00.317) 0:00:24.665 **** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* Wednesday 03 December 2025 10:50:35 +0000 (0:00:00.315) 0:00:24.981 **** ok: [instance] TASK [libvirt_manager : Manage service for older releases] ********************* Wednesday 03 December 2025 10:50:35 +0000 (0:00:00.312) 0:00:25.293 **** skipping: [instance] TASK [libvirt_manager : Get libvirt group users] ******************************* Wednesday 03 December 2025 10:50:35 +0000 (0:00:00.020) 0:00:25.314 **** ok: [instance] TASK [libvirt_manager : Add user if not exists in libvirt group] *************** Wednesday 03 December 2025 10:50:35 +0000 (0:00:00.297) 0:00:25.612 **** ok: [instance] TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** Wednesday 03 December 2025 10:50:36 +0000 (0:00:00.361) 0:00:25.973 **** changed: [instance] TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* Wednesday 03 December 2025 10:50:36 +0000 (0:00:00.306) 0:00:26.279 **** [WARNING]: Reset is not implemented for this connection changed: [instance] TASK [libvirt_manager : Ensure we reload user env] ***************************** Wednesday 03 December 2025 10:50:36 +0000 (0:00:00.275) 0:00:26.555 **** TASK [reproducer : Deploy networks in libvirt] ********************************* Wednesday 03 December 2025 10:50:36 +0000 (0:00:00.014) 0:00:26.569 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance TASK [reproducer : Ensure networks are consistent] ***************************** Wednesday 03 December 2025 10:50:36 +0000 (0:00:00.072) 0:00:26.642 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Wednesday 03 December 2025 10:50:36 +0000 (0:00:00.041) 0:00:26.683 **** ok: [instance] => (item=compute) ok: [instance] => (item=controller) ok: [instance] => (item=crc) TASK [reproducer : Ensure all standard attached networks are defined] ********** Wednesday 03 December 2025 10:50:37 +0000 (0:00:00.083) 0:00:26.767 **** ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Wednesday 03 December 2025 10:50:37 +0000 (0:00:00.041) 0:00:26.809 **** ok: [instance] => changed=false msg: All assertions passed TASK [Ensure we get latest OCP config] ***************************************** Wednesday 03 December 2025 10:50:37 +0000 (0:00:00.040) 0:00:26.850 **** TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** Wednesday 03 December 2025 10:50:37 +0000 (0:00:00.039) 0:00:26.889 **** ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) ok: [instance] => (item={}) TASK [devscripts : Replace OCP version if "stable-" alias used] **************** Wednesday 03 December 2025 10:50:37 +0000 (0:00:00.070) 0:00:26.959 **** skipping: [instance] TASK [devscripts : Ensure output directory exists] ***************************** Wednesday 03 December 2025 10:50:37 +0000 (0:00:00.017) 0:00:26.977 **** ok: [instance] TASK [devscripts : Output built config for easier debugging] ******************* Wednesday 03 December 2025 10:50:37 +0000 (0:00:00.208) 0:00:27.185 **** changed: [instance] TASK [ci_network : Remove the local dns configuration] ************************* Wednesday 03 December 2025 10:50:37 +0000 (0:00:00.324) 0:00:27.509 **** ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) TASK [ci_network : Reload the NetworkManager to pick the changes] ************** Wednesday 03 December 2025 10:50:38 +0000 (0:00:00.700) 0:00:28.210 **** skipping: [instance] TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* Wednesday 03 December 2025 10:50:38 +0000 (0:00:00.027) 0:00:28.237 **** changed: [instance] TASK [reproducer : Flush handlers for NetworkManager restart] ****************** Wednesday 03 December 2025 10:50:38 +0000 (0:00:00.342) 0:00:28.580 **** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Wednesday 03 December 2025 10:50:38 +0000 (0:00:00.008) 0:00:28.588 **** changed: [instance] TASK [Ensure no default networks exists] *************************************** Wednesday 03 December 2025 10:50:39 +0000 (0:00:00.411) 0:00:29.000 **** TASK [libvirt_manager : Deactivate crc] **************************************** Wednesday 03 December 2025 10:50:39 +0000 (0:00:00.073) 0:00:29.073 **** ok: [instance] TASK [libvirt_manager : Removing crc] ****************************************** Wednesday 03 December 2025 10:50:40 +0000 (0:00:01.150) 0:00:30.224 **** ok: [instance] TASK [libvirt_manager : Deactivate default] ************************************ Wednesday 03 December 2025 10:50:40 +0000 (0:00:00.222) 0:00:30.446 **** ok: [instance] TASK [libvirt_manager : Removing default] ************************************** Wednesday 03 December 2025 10:50:41 +0000 (0:00:00.505) 0:00:30.952 **** ok: [instance] TASK [reproducer : Ensure firewalld is installed] ****************************** Wednesday 03 December 2025 10:50:41 +0000 (0:00:00.217) 0:00:31.169 **** ok: [instance] TASK [reproducer : Ensure firewalld service is enabled and started] ************ Wednesday 03 December 2025 10:50:42 +0000 (0:00:01.123) 0:00:32.292 **** ok: [instance] TASK [reproducer : Ensure br_netfilter module is loaded] *********************** Wednesday 03 December 2025 10:50:42 +0000 (0:00:00.292) 0:00:32.585 **** changed: [instance] TASK [reproducer : Ensure IP forwarding is enabled] **************************** Wednesday 03 December 2025 10:50:43 +0000 (0:00:00.292) 0:00:32.877 **** changed: [instance] TASK [reproducer : Ensure the required parameters are loaded] ****************** Wednesday 03 December 2025 10:50:43 +0000 (0:00:00.291) 0:00:33.169 **** changed: [instance] => (item=arptables) changed: [instance] => (item=iptables) changed: [instance] => (item=ip6tables) TASK [reproducer : Ensure firewall service is enabled and started] ************* Wednesday 03 December 2025 10:50:43 +0000 (0:00:00.542) 0:00:33.711 **** ok: [instance] TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.312) 0:00:34.024 **** ok: [instance] TASK [Ensure the required network configurations are applied] ****************** Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.085) 0:00:34.110 **** TASK [networking_mapper : Check for Networking Environment Definition file existence] *** Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.040) 0:00:34.150 **** skipping: [instance] TASK [networking_mapper : Check for Networking Definition file existance] ****** Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.022) 0:00:34.173 **** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.023) 0:00:34.197 **** skipping: [instance] TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.022) 0:00:34.219 **** skipping: [instance] TASK [ci_nmstate : Initialize NMstates for each instance] ********************** Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.026) 0:00:34.246 **** ok: [instance] TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.036) 0:00:34.282 **** skipping: [instance] TASK [ci_nmstate : Get k8s nodes] ********************************************** Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.031) 0:00:34.313 **** skipping: [instance] TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.021) 0:00:34.334 **** ok: [instance] TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.054) 0:00:34.389 **** skipping: [instance] TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.023) 0:00:34.412 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) TASK [ci_nmstate : Ensure we have needed facts] ******************************** Wednesday 03 December 2025 10:50:44 +0000 (0:00:00.046) 0:00:34.458 **** ok: [instance -> localhost] TASK [ci_nmstate : Install required packages on localhost] ********************* Wednesday 03 December 2025 10:50:45 +0000 (0:00:00.312) 0:00:34.771 **** changed: [instance -> localhost] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Wednesday 03 December 2025 10:50:50 +0000 (0:00:05.127) 0:00:39.898 **** changed: [instance] TASK [ci_nmstate : Save nmstate state for localhost] *************************** Wednesday 03 December 2025 10:50:50 +0000 (0:00:00.189) 0:00:40.088 **** changed: [instance] TASK [ci_nmstate : Apply the desidered state on localhost] ********************* Wednesday 03 December 2025 10:50:50 +0000 (0:00:00.336) 0:00:40.424 **** changed: [instance -> localhost] TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** Wednesday 03 December 2025 10:50:52 +0000 (0:00:01.576) 0:00:42.000 **** changed: [instance] TASK [reproducer : Select right domain] **************************************** Wednesday 03 December 2025 10:50:52 +0000 (0:00:00.327) 0:00:42.327 **** ok: [instance] TASK [Create the virtual networks] ********************************************* Wednesday 03 December 2025 10:50:52 +0000 (0:00:00.029) 0:00:42.356 **** TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** Wednesday 03 December 2025 10:50:52 +0000 (0:00:00.108) 0:00:42.465 **** ok: [instance] TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* Wednesday 03 December 2025 10:50:52 +0000 (0:00:00.017) 0:00:42.483 **** ok: [instance] TASK [libvirt_manager : Load file if exists] *********************************** Wednesday 03 December 2025 10:50:52 +0000 (0:00:00.179) 0:00:42.662 **** skipping: [instance] TASK [libvirt_manager : Update fact with existing content] ********************* Wednesday 03 December 2025 10:50:52 +0000 (0:00:00.028) 0:00:42.691 **** skipping: [instance] TASK [libvirt_manager : Generate VM list] ************************************** Wednesday 03 December 2025 10:50:52 +0000 (0:00:00.026) 0:00:42.717 **** ok: [instance] TASK [libvirt_manager : Generate/update mapping all nodes] ********************* Wednesday 03 December 2025 10:50:53 +0000 (0:00:00.049) 0:00:42.766 **** ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Append baremetal nodes if needed] ********************** Wednesday 03 December 2025 10:50:53 +0000 (0:00:00.140) 0:00:42.907 **** skipping: [instance] TASK [libvirt_manager : Dump MAC mapping] ************************************** Wednesday 03 December 2025 10:50:53 +0000 (0:00:00.032) 0:00:42.940 **** changed: [instance] TASK [libvirt_manager : Inject all VMs in the inventory] *********************** Wednesday 03 December 2025 10:50:53 +0000 (0:00:00.329) 0:00:43.269 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) TASK [libvirt_manager : Add host to runtime inventory] ************************* Wednesday 03 December 2025 10:50:53 +0000 (0:00:00.085) 0:00:43.355 **** changed: [instance] TASK [libvirt_manager : Ensure group section exists] *************************** Wednesday 03 December 2025 10:50:53 +0000 (0:00:00.051) 0:00:43.406 **** changed: [instance] TASK [libvirt_manager : Append host under proper group] ************************ Wednesday 03 December 2025 10:50:53 +0000 (0:00:00.268) 0:00:43.675 **** changed: [instance] TASK [libvirt_manager : Add host to runtime inventory] ************************* Wednesday 03 December 2025 10:50:54 +0000 (0:00:00.204) 0:00:43.879 **** changed: [instance] TASK [libvirt_manager : Ensure group section exists] *************************** Wednesday 03 December 2025 10:50:54 +0000 (0:00:00.049) 0:00:43.929 **** changed: [instance] TASK [libvirt_manager : Append host under proper group] ************************ Wednesday 03 December 2025 10:50:54 +0000 (0:00:00.196) 0:00:44.126 **** changed: [instance] TASK [libvirt_manager : Add host to runtime inventory] ************************* Wednesday 03 December 2025 10:50:54 +0000 (0:00:00.208) 0:00:44.334 **** changed: [instance] TASK [libvirt_manager : Ensure group section exists] *************************** Wednesday 03 December 2025 10:50:54 +0000 (0:00:00.052) 0:00:44.387 **** changed: [instance] TASK [libvirt_manager : Append host under proper group] ************************ Wednesday 03 December 2025 10:50:54 +0000 (0:00:00.192) 0:00:44.580 **** changed: [instance] TASK [libvirt_manager : Check if ini inventory file exists] ******************** Wednesday 03 December 2025 10:50:55 +0000 (0:00:00.209) 0:00:44.789 **** ok: [instance] TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** Wednesday 03 December 2025 10:50:55 +0000 (0:00:00.193) 0:00:44.982 **** changed: [instance] TASK [networking_mapper : Check for Networking Definition file existence] ****** Wednesday 03 December 2025 10:50:55 +0000 (0:00:00.494) 0:00:45.477 **** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Wednesday 03 December 2025 10:50:55 +0000 (0:00:00.024) 0:00:45.501 **** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Wednesday 03 December 2025 10:50:55 +0000 (0:00:00.023) 0:00:45.524 **** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Wednesday 03 December 2025 10:50:55 +0000 (0:00:00.023) 0:00:45.548 **** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Wednesday 03 December 2025 10:50:55 +0000 (0:00:00.022) 0:00:45.570 **** ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Wednesday 03 December 2025 10:50:55 +0000 (0:00:00.019) 0:00:45.590 **** ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Wednesday 03 December 2025 10:50:55 +0000 (0:00:00.074) 0:00:45.664 **** skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Wednesday 03 December 2025 10:50:55 +0000 (0:00:00.018) 0:00:45.683 **** changed: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Wednesday 03 December 2025 10:50:56 +0000 (0:00:00.206) 0:00:45.889 **** changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Wednesday 03 December 2025 10:50:56 +0000 (0:00:00.397) 0:00:46.287 **** ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Wednesday 03 December 2025 10:50:56 +0000 (0:00:00.057) 0:00:46.345 **** ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Wednesday 03 December 2025 10:50:56 +0000 (0:00:00.032) 0:00:46.377 **** changed: [instance] TASK [libvirt_manager : Manage networks if needed] ***************************** Wednesday 03 December 2025 10:50:56 +0000 (0:00:00.365) 0:00:46.742 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** Wednesday 03 December 2025 10:50:57 +0000 (0:00:00.078) 0:00:46.821 **** ok: [instance] => (item=public) ok: [instance] => (item=osp_trunk) TASK [libvirt_manager : Ensure networks are defined] *************************** Wednesday 03 December 2025 10:50:57 +0000 (0:00:00.047) 0:00:46.869 **** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are created/started] ******************* Wednesday 03 December 2025 10:50:57 +0000 (0:00:00.437) 0:00:47.307 **** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are active] **************************** Wednesday 03 December 2025 10:50:58 +0000 (0:00:00.563) 0:00:47.871 **** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** Wednesday 03 December 2025 10:50:58 +0000 (0:00:00.427) 0:00:48.299 **** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** Wednesday 03 December 2025 10:50:58 +0000 (0:00:00.417) 0:00:48.716 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance TASK [libvirt_manager : Fetch present bridge interfaces] *********************** Wednesday 03 December 2025 10:50:59 +0000 (0:00:00.059) 0:00:48.776 **** ok: [instance] TASK [libvirt_manager : Fetch bridges ports link info] ************************* Wednesday 03 December 2025 10:50:59 +0000 (0:00:00.180) 0:00:48.957 **** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [Create dummy interfaces to ensure bridges are UP] ************************ Wednesday 03 December 2025 10:50:59 +0000 (0:00:00.367) 0:00:49.325 **** TASK [ci_nmstate : Ensure we have needed facts] ******************************** Wednesday 03 December 2025 10:50:59 +0000 (0:00:00.067) 0:00:49.392 **** skipping: [instance] TASK [ci_nmstate : Install required packages on instance] ********************** Wednesday 03 December 2025 10:50:59 +0000 (0:00:00.036) 0:00:49.429 **** ok: [instance] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Wednesday 03 December 2025 10:51:00 +0000 (0:00:01.163) 0:00:50.592 **** ok: [instance] TASK [ci_nmstate : Save nmstate state for instance] **************************** Wednesday 03 December 2025 10:51:01 +0000 (0:00:00.187) 0:00:50.780 **** changed: [instance] TASK [ci_nmstate : Apply the desidered state on instance] ********************** Wednesday 03 December 2025 10:51:01 +0000 (0:00:00.348) 0:00:51.128 **** changed: [instance] TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* Wednesday 03 December 2025 10:51:02 +0000 (0:00:01.622) 0:00:52.751 **** changed: [instance] TASK [Create extra network configuration] ************************************** Wednesday 03 December 2025 10:51:03 +0000 (0:00:00.348) 0:00:53.099 **** skipping: [instance] TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** Wednesday 03 December 2025 10:51:03 +0000 (0:00:00.030) 0:00:53.129 **** skipping: [instance] TASK [libvirt_manager : Refresh networking facts on host] ********************** Wednesday 03 December 2025 10:51:03 +0000 (0:00:00.027) 0:00:53.156 **** ok: [instance] TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** Wednesday 03 December 2025 10:51:03 +0000 (0:00:00.420) 0:00:53.577 **** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [dnsmasq : Install needed packages] *************************************** Wednesday 03 December 2025 10:51:03 +0000 (0:00:00.139) 0:00:53.717 **** ok: [instance] TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** Wednesday 03 December 2025 10:51:05 +0000 (0:00:01.128) 0:00:54.845 **** changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) TASK [dnsmasq : Manage configuration directory] ******************************** Wednesday 03 December 2025 10:51:08 +0000 (0:00:03.538) 0:00:58.383 **** changed: [instance] TASK [dnsmasq : Manage systemd unit file] ************************************** Wednesday 03 December 2025 10:51:08 +0000 (0:00:00.206) 0:00:58.590 **** changed: [instance] TASK [dnsmasq : Manage base configuration file] ******************************** Wednesday 03 December 2025 10:51:09 +0000 (0:00:00.341) 0:00:58.931 **** changed: [instance] TASK [dnsmasq : Render listener configuration] ********************************* Wednesday 03 December 2025 10:51:09 +0000 (0:00:00.374) 0:00:59.305 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance TASK [dnsmasq : Create listener configuration file] **************************** Wednesday 03 December 2025 10:51:09 +0000 (0:00:00.031) 0:00:59.337 **** changed: [instance] TASK [dnsmasq : Remove listener configuration file] **************************** Wednesday 03 December 2025 10:51:09 +0000 (0:00:00.376) 0:00:59.713 **** skipping: [instance] TASK [dnsmasq : Render dns configuration] ************************************** Wednesday 03 December 2025 10:51:09 +0000 (0:00:00.017) 0:00:59.731 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance TASK [dnsmasq : Create dns configuration file] ********************************* Wednesday 03 December 2025 10:51:10 +0000 (0:00:00.030) 0:00:59.762 **** changed: [instance] TASK [dnsmasq : Remove dns configuration file] ********************************* Wednesday 03 December 2025 10:51:10 +0000 (0:00:00.358) 0:01:00.120 **** skipping: [instance] TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** Wednesday 03 December 2025 10:51:10 +0000 (0:00:00.021) 0:01:00.142 **** ok: [instance] => (item=127.0.0.2) TASK [dnsmasq : Enable and start service] ************************************** Wednesday 03 December 2025 10:51:10 +0000 (0:00:00.209) 0:01:00.351 **** changed: [instance] TASK [dnsmasq : Stop service] ************************************************** Wednesday 03 December 2025 10:51:11 +0000 (0:00:00.664) 0:01:01.016 **** skipping: [instance] TASK [dnsmasq : Remove unit file] ********************************************** Wednesday 03 December 2025 10:51:11 +0000 (0:00:00.019) 0:01:01.035 **** skipping: [instance] TASK [dnsmasq : Remove main configuration files] ******************************* Wednesday 03 December 2025 10:51:11 +0000 (0:00:00.017) 0:01:01.053 **** skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) skipping: [instance] TASK [Create dnsmasq networks] ************************************************* Wednesday 03 December 2025 10:51:11 +0000 (0:00:00.029) 0:01:01.082 **** TASK [dnsmasq : Assert mandatory parameter] ************************************ Wednesday 03 December 2025 10:51:11 +0000 (0:00:00.115) 0:01:01.198 **** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Wednesday 03 December 2025 10:51:11 +0000 (0:00:00.032) 0:01:01.230 **** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Wednesday 03 December 2025 10:51:11 +0000 (0:00:00.038) 0:01:01.269 **** changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Wednesday 03 December 2025 10:51:11 +0000 (0:00:00.418) 0:01:01.687 **** skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Wednesday 03 December 2025 10:51:11 +0000 (0:00:00.019) 0:01:01.707 **** skipping: [instance] TASK [dnsmasq : Assert mandatory parameter] ************************************ Wednesday 03 December 2025 10:51:11 +0000 (0:00:00.024) 0:01:01.731 **** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Wednesday 03 December 2025 10:51:12 +0000 (0:00:00.028) 0:01:01.760 **** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Wednesday 03 December 2025 10:51:12 +0000 (0:00:00.036) 0:01:01.796 **** changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Wednesday 03 December 2025 10:51:12 +0000 (0:00:00.424) 0:01:02.221 **** skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Wednesday 03 December 2025 10:51:12 +0000 (0:00:00.018) 0:01:02.239 **** skipping: [instance] TASK [Deploy radvd for IPv6 router advertisements] ***************************** Wednesday 03 December 2025 10:51:12 +0000 (0:00:00.023) 0:01:02.263 **** skipping: [instance] TASK [libvirt_manager : Ensure network is in correct zone] ********************* Wednesday 03 December 2025 10:51:12 +0000 (0:00:00.031) 0:01:02.294 **** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Wednesday 03 December 2025 10:51:13 +0000 (0:00:00.490) 0:01:02.785 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Wednesday 03 December 2025 10:51:13 +0000 (0:00:00.035) 0:01:02.821 **** ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Wednesday 03 December 2025 10:51:13 +0000 (0:00:00.331) 0:01:03.152 **** ok: [instance] TASK [libvirt_manager : Extract IP address from network bridges] *************** Wednesday 03 December 2025 10:51:13 +0000 (0:00:00.037) 0:01:03.189 **** ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Wednesday 03 December 2025 10:51:13 +0000 (0:00:00.198) 0:01:03.388 **** ok: [instance] TASK [libvirt_manager : Output _network_data] ********************************** Wednesday 03 December 2025 10:51:13 +0000 (0:00:00.033) 0:01:03.422 **** changed: [instance] TASK [libvirt_manager : Output pub_net] **************************************** Wednesday 03 December 2025 10:51:14 +0000 (0:00:00.336) 0:01:03.758 **** changed: [instance] TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** Wednesday 03 December 2025 10:51:14 +0000 (0:00:00.336) 0:01:04.095 **** changed: [instance] TASK [libvirt_manager : Expose patch for networking_mapper] ******************** Wednesday 03 December 2025 10:51:14 +0000 (0:00:00.330) 0:01:04.425 **** ok: [instance] TASK [libvirt_manager : Save networking_mapper patch] ************************** Wednesday 03 December 2025 10:51:14 +0000 (0:00:00.092) 0:01:04.517 **** changed: [instance] TASK [networking_mapper : Check for Networking Definition file existence] ****** Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.315) 0:01:04.832 **** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.023) 0:01:04.856 **** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.025) 0:01:04.882 **** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.024) 0:01:04.906 **** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.024) 0:01:04.930 **** ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.019) 0:01:04.950 **** ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.108) 0:01:05.058 **** skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.020) 0:01:05.078 **** ok: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.196) 0:01:05.275 **** changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.383) 0:01:05.658 **** ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.063) 0:01:05.721 **** ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Wednesday 03 December 2025 10:51:15 +0000 (0:00:00.030) 0:01:05.751 **** changed: [instance] TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** Wednesday 03 December 2025 10:51:16 +0000 (0:00:00.431) 0:01:06.183 **** ok: [instance] TASK [libvirt_manager : Unset patch] ******************************************* Wednesday 03 December 2025 10:51:16 +0000 (0:00:00.030) 0:01:06.213 **** ok: [instance] TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** Wednesday 03 December 2025 10:51:16 +0000 (0:00:00.018) 0:01:06.232 **** ok: [instance] TASK [libvirt_manager : Reserve IPs on networks] ******************************* Wednesday 03 December 2025 10:51:16 +0000 (0:00:00.018) 0:01:06.250 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) TASK [libvirt_manager : Loop on host IPs] ************************************** Wednesday 03 December 2025 10:51:16 +0000 (0:00:00.071) 0:01:06.321 **** ok: [instance] => (item=compute-0 - ctlplane) ok: [instance] => (item=controller-0 - ctlplane) ok: [instance] => (item=crc-0 - ctlplane) TASK [libvirt_manager : Loop on host IPs] ************************************** Wednesday 03 December 2025 10:51:16 +0000 (0:00:00.137) 0:01:06.459 **** skipping: [instance] => (item=compute-0 - internalapi) skipping: [instance] => (item=controller-0 - internalapi) skipping: [instance] => (item=crc-0 - internalapi) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Wednesday 03 December 2025 10:51:16 +0000 (0:00:00.084) 0:01:06.543 **** skipping: [instance] => (item=compute-0 - storage) skipping: [instance] => (item=controller-0 - storage) skipping: [instance] => (item=crc-0 - storage) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Wednesday 03 December 2025 10:51:16 +0000 (0:00:00.082) 0:01:06.625 **** skipping: [instance] => (item=compute-0 - tenant) skipping: [instance] => (item=controller-0 - tenant) skipping: [instance] => (item=crc-0 - tenant) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Wednesday 03 December 2025 10:51:16 +0000 (0:00:00.084) 0:01:06.709 **** skipping: [instance] => (item=compute-0 - external) skipping: [instance] => (item=controller-0 - external) skipping: [instance] => (item=crc-0 - external) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.085) 0:01:06.794 **** skipping: [instance] => (item=compute-0 - storagemgmt) skipping: [instance] => (item=controller-0 - storagemgmt) skipping: [instance] => (item=crc-0 - storagemgmt) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.083) 0:01:06.878 **** ok: [instance] => (item=compute-0 - public) ok: [instance] => (item=controller-0 - public) ok: [instance] => (item=crc-0 - public) TASK [Inject DHCP entries for net {{ net_name }}] ****************************** Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.141) 0:01:07.019 **** TASK [dnsmasq : Ensure we have the right data and type] ************************ Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.112) 0:01:07.132 **** ok: [instance] TASK [dnsmasq : Assert we have needed host data] ******************************* Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.040) 0:01:07.173 **** ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:17:fc:59', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:5c:a8:7e', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:89:90:d0', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7e:31:96', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:f7:f1:6d', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:55:33:0d', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) TASK [dnsmasq : Ensure networks exists] **************************************** Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.104) 0:01:07.277 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) TASK [dnsmasq : Check network file status] ************************************* Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.049) 0:01:07.326 **** ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.173) 0:01:07.500 **** ok: [instance] TASK [dnsmasq : Check network file status] ************************************* Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.024) 0:01:07.524 **** ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.168) 0:01:07.693 **** ok: [instance] TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.023) 0:01:07.716 **** ok: [instance] TASK [dnsmasq : Compute entry] ************************************************* Wednesday 03 December 2025 10:51:17 +0000 (0:00:00.019) 0:01:07.736 **** ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:17:fc:59', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:5c:a8:7e', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:89:90:d0', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7e:31:96', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:f7:f1:6d', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:55:33:0d', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) TASK [dnsmasq : Create add/remove sets] **************************************** Wednesday 03 December 2025 10:51:18 +0000 (0:00:00.169) 0:01:07.905 **** ok: [instance] TASK [dnsmasq : Add DHCP entries] ********************************************** Wednesday 03 December 2025 10:51:18 +0000 (0:00:00.038) 0:01:07.944 **** changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:17:fc:59', 'entry': 'set:compute,52:54:00:17:fc:59,192.168.140.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:5c:a8:7e', 'entry': 'set:controller,52:54:01:5c:a8:7e,192.168.140.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:89:90:d0', 'entry': 'set:ocp,52:54:02:89:90:d0,192.168.140.10,crc-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_compute-0_52:54:00:7e:31:96', 'entry': 'set:compute,52:54:00:7e:31:96,192.168.101.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_controller-0_52:54:01:f7:f1:6d', 'entry': 'set:controller,52:54:01:f7:f1:6d,192.168.101.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_crc-0_52:54:02:55:33:0d', 'entry': 'set:ocp,52:54:02:55:33:0d,192.168.101.10,crc-0', 'state': 'present'}) TASK [dnsmasq : Remove DHCP entries] ******************************************* Wednesday 03 December 2025 10:51:20 +0000 (0:00:01.955) 0:01:09.899 **** skipping: [instance] TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** Wednesday 03 December 2025 10:51:20 +0000 (0:00:00.021) 0:01:09.921 **** ok: [instance] => (item=compute-0) ok: [instance] => (item=controller-0) ok: [instance] => (item=crc-0) TASK [Inject VMs in the .utility zone] ***************************************** Wednesday 03 December 2025 10:51:20 +0000 (0:00:00.203) 0:01:10.125 **** TASK [dnsmasq : Assert we have needed host record data] ************************ Wednesday 03 December 2025 10:51:20 +0000 (0:00:00.111) 0:01:10.236 **** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Wednesday 03 December 2025 10:51:20 +0000 (0:00:00.090) 0:01:10.327 **** ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Wednesday 03 December 2025 10:51:20 +0000 (0:00:00.202) 0:01:10.529 **** changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** Wednesday 03 December 2025 10:51:23 +0000 (0:00:03.003) 0:01:13.532 **** ok: [instance] TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** Wednesday 03 December 2025 10:51:23 +0000 (0:00:00.020) 0:01:13.553 **** skipping: [instance] => (item=compute) skipping: [instance] => (item=controller) skipping: [instance] => (item=crc) skipping: [instance] TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* Wednesday 03 December 2025 10:51:23 +0000 (0:00:00.042) 0:01:13.595 **** skipping: [instance] TASK [libvirt_manager : Ensure some domains are local] ************************* Wednesday 03 December 2025 10:51:23 +0000 (0:00:00.030) 0:01:13.626 **** changed: [instance] TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ Wednesday 03 December 2025 10:51:24 +0000 (0:00:00.378) 0:01:14.004 **** RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Wednesday 03 December 2025 10:51:24 +0000 (0:00:00.010) 0:01:14.014 **** changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Wednesday 03 December 2025 10:51:25 +0000 (0:00:00.789) 0:01:14.803 **** changed: [instance] RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* Wednesday 03 December 2025 10:51:25 +0000 (0:00:00.349) 0:01:15.153 **** changed: [instance] TASK [reproducer : Delegate our domains to our own instance] ******************* Wednesday 03 December 2025 10:51:25 +0000 (0:00:00.343) 0:01:15.496 **** changed: [instance] TASK [reproducer : Ensure "utility" domain is local] *************************** Wednesday 03 December 2025 10:51:26 +0000 (0:00:00.350) 0:01:15.847 **** changed: [instance] TASK [Build utility records dataset] ******************************************* Wednesday 03 December 2025 10:51:26 +0000 (0:00:00.359) 0:01:16.206 **** TASK [dnsmasq : Assert we have needed host record data] ************************ Wednesday 03 December 2025 10:51:26 +0000 (0:00:00.032) 0:01:16.239 **** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Wednesday 03 December 2025 10:51:26 +0000 (0:00:00.086) 0:01:16.325 **** ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Wednesday 03 December 2025 10:51:26 +0000 (0:00:00.095) 0:01:16.421 **** changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [reproducer : Flush handlers] ********************************************* Wednesday 03 December 2025 10:51:27 +0000 (0:00:00.449) 0:01:16.870 **** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Wednesday 03 December 2025 10:51:27 +0000 (0:00:00.010) 0:01:16.881 **** changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Wednesday 03 December 2025 10:51:27 +0000 (0:00:00.451) 0:01:17.333 **** changed: [instance] TASK [reproducer : Bootstrap nat64 if needed] ********************************** Wednesday 03 December 2025 10:51:27 +0000 (0:00:00.341) 0:01:17.675 **** skipping: [instance] TASK [reproducer : Deploy CRC if needed] *************************************** Wednesday 03 December 2025 10:51:27 +0000 (0:00:00.030) 0:01:17.705 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance TASK [reproducer : Check for CRC availability in known path] ******************* Wednesday 03 December 2025 10:51:28 +0000 (0:00:00.072) 0:01:17.778 **** ok: [instance] TASK [Deploy CRC if needed] **************************************************** Wednesday 03 December 2025 10:51:28 +0000 (0:00:00.183) 0:01:17.961 **** skipping: [instance] TASK [rhol_crc : Stop CRC VM] ************************************************** Wednesday 03 December 2025 10:51:28 +0000 (0:00:00.019) 0:01:17.981 **** ok: [instance] TASK [rhol_crc : Undefine CRC VM] ********************************************** Wednesday 03 December 2025 10:51:28 +0000 (0:00:00.333) 0:01:18.314 **** ok: [instance] TASK [rhol_crc : Destroy CRC network] ****************************************** Wednesday 03 December 2025 10:51:28 +0000 (0:00:00.230) 0:01:18.545 **** ok: [instance] TASK [rhol_crc : Undefine CRC network] ***************************************** Wednesday 03 December 2025 10:51:28 +0000 (0:00:00.208) 0:01:18.753 **** ok: [instance] TASK [rhol_crc : Destroy default network] ************************************** Wednesday 03 December 2025 10:51:29 +0000 (0:00:00.211) 0:01:18.964 **** ok: [instance] TASK [Check if new ssh keypair exists] ***************************************** Wednesday 03 December 2025 10:51:29 +0000 (0:00:00.215) 0:01:19.179 **** TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Wednesday 03 December 2025 10:51:29 +0000 (0:00:00.040) 0:01:19.220 **** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Wednesday 03 December 2025 10:51:29 +0000 (0:00:00.193) 0:01:19.413 **** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Wednesday 03 December 2025 10:51:29 +0000 (0:00:00.023) 0:01:19.437 **** skipping: [instance] TASK [reproducer : Slurp ssh key for CRC access] ******************************* Wednesday 03 December 2025 10:51:29 +0000 (0:00:00.023) 0:01:19.461 **** ok: [instance] TASK [reproducer : Get kubeconfig file from crc directory] ********************* Wednesday 03 December 2025 10:51:29 +0000 (0:00:00.238) 0:01:19.699 **** ok: [instance] TASK [reproducer : Get kubeadmin-password file from crc directory] ************* Wednesday 03 December 2025 10:51:30 +0000 (0:00:00.210) 0:01:19.909 **** ok: [instance] TASK [Ensure we expose openshift_login related facts] ************************** Wednesday 03 December 2025 10:51:30 +0000 (0:00:00.166) 0:01:20.076 **** TASK [openshift_login : Assert we have needed parameters] ********************** Wednesday 03 December 2025 10:51:30 +0000 (0:00:00.053) 0:01:20.129 **** ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Stat kubeconfig] *************************************** Wednesday 03 December 2025 10:51:30 +0000 (0:00:00.040) 0:01:20.170 **** ok: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Wednesday 03 December 2025 10:51:30 +0000 (0:00:00.167) 0:01:20.337 **** ok: [instance] TASK [openshift_login : Assert files exist] ************************************ Wednesday 03 December 2025 10:51:30 +0000 (0:00:00.175) 0:01:20.513 **** ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Gather the password of the deployed cluster.] ********** Wednesday 03 December 2025 10:51:30 +0000 (0:00:00.023) 0:01:20.536 **** ok: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Wednesday 03 December 2025 10:51:30 +0000 (0:00:00.176) 0:01:20.713 **** ok: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Wednesday 03 December 2025 10:51:31 +0000 (0:00:00.164) 0:01:20.878 **** ok: [instance] TASK [reproducer : Remove CRC managed zone delegation] ************************* Wednesday 03 December 2025 10:51:31 +0000 (0:00:00.045) 0:01:20.924 **** changed: [instance] => (item=dnsmasq.d/crc.conf) changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ Wednesday 03 December 2025 10:51:31 +0000 (0:00:00.363) 0:01:21.287 **** skipping: [instance] TASK [Load the architecture local kustomize patches] *************************** Wednesday 03 December 2025 10:51:31 +0000 (0:00:00.019) 0:01:21.307 **** skipping: [instance] TASK [reproducer : Consume libvirt_manager] ************************************ Wednesday 03 December 2025 10:51:31 +0000 (0:00:00.023) 0:01:21.330 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance TASK [libvirt_manager : Import layout generator if needed] ********************* Wednesday 03 December 2025 10:51:31 +0000 (0:00:00.126) 0:01:21.456 **** skipping: [instance] TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** Wednesday 03 December 2025 10:51:31 +0000 (0:00:00.024) 0:01:21.480 **** changed: [instance] TASK [libvirt_manager : Enable masquerading for public traffic] **************** Wednesday 03 December 2025 10:51:32 +0000 (0:00:00.386) 0:01:21.867 **** changed: [instance] TASK [libvirt_manager : Ensure firewalld is restarts] ************************** Wednesday 03 December 2025 10:51:32 +0000 (0:00:00.476) 0:01:22.344 **** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Wednesday 03 December 2025 10:51:32 +0000 (0:00:00.010) 0:01:22.354 **** changed: [instance] RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Wednesday 03 December 2025 10:51:33 +0000 (0:00:00.410) 0:01:22.765 **** changed: [instance] TASK [Deploy virtualbmc] ******************************************************* Wednesday 03 December 2025 10:51:33 +0000 (0:00:00.780) 0:01:23.545 **** skipping: [instance] TASK [libvirt_manager : Let the project know we have vbmc available] *********** Wednesday 03 December 2025 10:51:33 +0000 (0:00:00.032) 0:01:23.578 **** skipping: [instance] TASK [libvirt_manager : Create needed workload directory] ********************** Wednesday 03 December 2025 10:51:33 +0000 (0:00:00.030) 0:01:23.608 **** changed: [instance] => (item=workload) changed: [instance] => (item=reproducer-inventory) ok: [instance] => (item=volumes) TASK [libvirt_manager : Allow QEMU on workload directory] ********************** Wednesday 03 December 2025 10:51:34 +0000 (0:00:00.548) 0:01:24.157 **** changed: [instance] => (item=workload) changed: [instance] => (item=volumes) TASK [libvirt_manager : Generate networking data] ****************************** Wednesday 03 December 2025 10:51:34 +0000 (0:00:00.397) 0:01:24.555 **** skipping: [instance] TASK [libvirt_manager : Create group inventories] ****************************** Wednesday 03 December 2025 10:51:34 +0000 (0:00:00.026) 0:01:24.581 **** changed: [instance] => (item=compute) changed: [instance] => (item=controller) changed: [instance] => (item=crc) TASK [libvirt_manager : Create "all" group inventory file] ********************* Wednesday 03 December 2025 10:51:35 +0000 (0:00:00.979) 0:01:25.560 **** changed: [instance] TASK [libvirt_manager : Ensure storage pool is present.] *********************** Wednesday 03 December 2025 10:51:36 +0000 (0:00:00.361) 0:01:25.922 **** skipping: [instance] TASK [libvirt_manager : Ensure images are present] ***************************** Wednesday 03 December 2025 10:51:36 +0000 (0:00:00.038) 0:01:25.961 **** skipping: [instance] => (item=crc) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) TASK [libvirt_manager : Ensure directory exists] ******************************* Wednesday 03 December 2025 10:51:36 +0000 (0:00:00.065) 0:01:26.027 **** changed: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Wednesday 03 December 2025 10:51:36 +0000 (0:00:00.207) 0:01:26.235 **** ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Wednesday 03 December 2025 10:51:36 +0000 (0:00:00.168) 0:01:26.403 **** changed: [instance] TASK [libvirt_manager : Check image] ******************************************* Wednesday 03 December 2025 10:51:57 +0000 (0:00:20.368) 0:01:46.772 **** ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Wednesday 03 December 2025 10:51:57 +0000 (0:00:00.200) 0:01:46.973 **** ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Wednesday 03 December 2025 10:51:57 +0000 (0:00:00.043) 0:01:47.016 **** changed: [instance] TASK [libvirt_manager : Ensure directory exists] ******************************* Wednesday 03 December 2025 10:51:57 +0000 (0:00:00.198) 0:01:47.215 **** ok: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Wednesday 03 December 2025 10:51:57 +0000 (0:00:00.199) 0:01:47.414 **** ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Wednesday 03 December 2025 10:51:57 +0000 (0:00:00.190) 0:01:47.604 **** skipping: [instance] TASK [libvirt_manager : Check image] ******************************************* Wednesday 03 December 2025 10:51:57 +0000 (0:00:00.023) 0:01:47.628 **** ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Wednesday 03 December 2025 10:51:58 +0000 (0:00:00.199) 0:01:47.827 **** ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Wednesday 03 December 2025 10:51:58 +0000 (0:00:00.042) 0:01:47.869 **** ok: [instance] TASK [libvirt_manager : Get ssh key state] ************************************* Wednesday 03 December 2025 10:51:58 +0000 (0:00:00.201) 0:01:48.071 **** ok: [instance] TASK [libvirt_manager : Create temporary ssh keypair] ************************** Wednesday 03 December 2025 10:51:58 +0000 (0:00:00.175) 0:01:48.246 **** changed: [instance] TASK [libvirt_manager : Slurp public key for later use] ************************ Wednesday 03 December 2025 10:51:58 +0000 (0:00:00.378) 0:01:48.624 **** ok: [instance] TASK [libvirt_manager : Slurp private key for later use] *********************** Wednesday 03 December 2025 10:51:59 +0000 (0:00:00.169) 0:01:48.793 **** ok: [instance] TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** Wednesday 03 December 2025 10:51:59 +0000 (0:00:00.165) 0:01:48.959 **** changed: [instance] TASK [libvirt_manager : Create fact holding network data for VMs] ************** Wednesday 03 December 2025 10:51:59 +0000 (0:00:00.375) 0:01:49.335 **** ok: [instance] TASK [libvirt_manager : List existing networks] ******************************** Wednesday 03 December 2025 10:51:59 +0000 (0:00:00.021) 0:01:49.356 **** ok: [instance] TASK [libvirt_manager : Gather pool fact] ************************************** Wednesday 03 December 2025 10:51:59 +0000 (0:00:00.226) 0:01:49.583 **** ok: [instance] TASK [libvirt_manager : Create and run VMs] ************************************ Wednesday 03 December 2025 10:52:00 +0000 (0:00:00.450) 0:01:50.033 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Create VM image for compute-0] ************************* Wednesday 03 December 2025 10:52:00 +0000 (0:00:00.114) 0:01:50.148 **** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** Wednesday 03 December 2025 10:52:00 +0000 (0:00:00.250) 0:01:50.399 **** changed: [instance] TASK [libvirt_manager : Define VMs for type compute-0] ************************* Wednesday 03 December 2025 10:52:00 +0000 (0:00:00.214) 0:01:50.613 **** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** Wednesday 03 December 2025 10:52:01 +0000 (0:00:00.312) 0:01:50.925 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Wednesday 03 December 2025 10:52:01 +0000 (0:00:00.034) 0:01:50.960 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Wednesday 03 December 2025 10:52:01 +0000 (0:00:00.055) 0:01:51.015 **** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Wednesday 03 December 2025 10:52:01 +0000 (0:00:00.241) 0:01:51.256 **** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Wednesday 03 December 2025 10:52:01 +0000 (0:00:00.047) 0:01:51.303 **** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Wednesday 03 December 2025 10:52:01 +0000 (0:00:00.226) 0:01:51.530 **** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ Wednesday 03 December 2025 10:52:01 +0000 (0:00:00.200) 0:01:51.730 **** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Wednesday 03 December 2025 10:52:02 +0000 (0:00:00.289) 0:01:52.020 **** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Wednesday 03 December 2025 10:52:02 +0000 (0:00:00.230) 0:01:52.250 **** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Wednesday 03 December 2025 10:52:02 +0000 (0:00:00.045) 0:01:52.296 **** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Wednesday 03 December 2025 10:52:02 +0000 (0:00:00.223) 0:01:52.520 **** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* Wednesday 03 December 2025 10:52:02 +0000 (0:00:00.195) 0:01:52.716 **** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** Wednesday 03 December 2025 10:52:03 +0000 (0:00:00.290) 0:01:53.006 **** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** Wednesday 03 December 2025 10:52:03 +0000 (0:00:00.022) 0:01:53.029 **** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** Wednesday 03 December 2025 10:52:03 +0000 (0:00:00.028) 0:01:53.057 **** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** Wednesday 03 December 2025 10:52:03 +0000 (0:00:00.027) 0:01:53.085 **** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Wednesday 03 December 2025 10:52:03 +0000 (0:00:00.025) 0:01:53.111 **** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Wednesday 03 December 2025 10:52:03 +0000 (0:00:00.210) 0:01:53.322 **** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Wednesday 03 December 2025 10:52:03 +0000 (0:00:00.037) 0:01:53.359 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Wednesday 03 December 2025 10:52:03 +0000 (0:00:00.054) 0:01:53.414 **** ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Wednesday 03 December 2025 10:52:03 +0000 (0:00:00.190) 0:01:53.605 **** ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Wednesday 03 December 2025 10:52:03 +0000 (0:00:00.061) 0:01:53.666 **** ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Wednesday 03 December 2025 10:52:03 +0000 (0:00:00.044) 0:01:53.711 **** skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Wednesday 03 December 2025 10:52:04 +0000 (0:00:00.043) 0:01:53.755 **** skipping: [instance] TASK [Call the config_drive role] ********************************************** Wednesday 03 December 2025 10:52:04 +0000 (0:00:00.040) 0:01:53.796 **** TASK [config_drive : Ensure needed directories exist] ************************** Wednesday 03 December 2025 10:52:04 +0000 (0:00:00.057) 0:01:53.853 **** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Wednesday 03 December 2025 10:52:04 +0000 (0:00:00.382) 0:01:54.236 **** ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Wednesday 03 December 2025 10:52:05 +0000 (0:00:01.121) 0:01:55.358 **** changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Wednesday 03 December 2025 10:52:05 +0000 (0:00:00.208) 0:01:55.566 **** changed: [instance] TASK [config_drive : Generate user-data] *************************************** Wednesday 03 December 2025 10:52:06 +0000 (0:00:00.348) 0:01:55.915 **** changed: [instance] TASK [config_drive : Generate network-data] ************************************ Wednesday 03 December 2025 10:52:06 +0000 (0:00:00.357) 0:01:56.273 **** skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Wednesday 03 December 2025 10:52:06 +0000 (0:00:00.045) 0:01:56.319 **** ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Wednesday 03 December 2025 10:52:06 +0000 (0:00:00.199) 0:01:56.518 **** skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Wednesday 03 December 2025 10:52:06 +0000 (0:00:00.042) 0:01:56.561 **** Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Wednesday 03 December 2025 10:52:07 +0000 (0:00:00.233) 0:01:56.794 **** changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Wednesday 03 December 2025 10:52:07 +0000 (0:00:00.269) 0:01:57.064 **** skipping: [instance] TASK [libvirt_manager : Configure boot order for compute-0] ******************** Wednesday 03 December 2025 10:52:07 +0000 (0:00:00.046) 0:01:57.110 **** skipping: [instance] TASK [libvirt_manager : Create VM image for controller-0] ********************** Wednesday 03 December 2025 10:52:07 +0000 (0:00:00.029) 0:01:57.139 **** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** Wednesday 03 December 2025 10:52:07 +0000 (0:00:00.248) 0:01:57.387 **** changed: [instance] TASK [libvirt_manager : Define VMs for type controller-0] ********************** Wednesday 03 December 2025 10:52:07 +0000 (0:00:00.216) 0:01:57.604 **** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** Wednesday 03 December 2025 10:52:08 +0000 (0:00:00.279) 0:01:57.883 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Wednesday 03 December 2025 10:52:08 +0000 (0:00:00.029) 0:01:57.913 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Wednesday 03 December 2025 10:52:08 +0000 (0:00:00.043) 0:01:57.956 **** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Wednesday 03 December 2025 10:52:08 +0000 (0:00:00.224) 0:01:58.181 **** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Wednesday 03 December 2025 10:52:08 +0000 (0:00:00.046) 0:01:58.227 **** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Wednesday 03 December 2025 10:52:08 +0000 (0:00:00.229) 0:01:58.456 **** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* Wednesday 03 December 2025 10:52:08 +0000 (0:00:00.193) 0:01:58.649 **** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Wednesday 03 December 2025 10:52:09 +0000 (0:00:00.263) 0:01:58.913 **** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Wednesday 03 December 2025 10:52:09 +0000 (0:00:00.222) 0:01:59.135 **** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Wednesday 03 December 2025 10:52:09 +0000 (0:00:00.042) 0:01:59.178 **** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Wednesday 03 December 2025 10:52:09 +0000 (0:00:00.223) 0:01:59.401 **** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** Wednesday 03 December 2025 10:52:09 +0000 (0:00:00.198) 0:01:59.600 **** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.268) 0:01:59.868 **** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.020) 0:01:59.889 **** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.027) 0:01:59.916 **** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.026) 0:01:59.942 **** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.025) 0:01:59.968 **** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.207) 0:02:00.176 **** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.089) 0:02:00.265 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.052) 0:02:00.318 **** ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.186) 0:02:00.504 **** ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.060) 0:02:00.565 **** ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.043) 0:02:00.608 **** skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.040) 0:02:00.649 **** skipping: [instance] TASK [Call the config_drive role] ********************************************** Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.041) 0:02:00.690 **** TASK [config_drive : Ensure needed directories exist] ************************** Wednesday 03 December 2025 10:52:10 +0000 (0:00:00.059) 0:02:00.750 **** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Wednesday 03 December 2025 10:52:11 +0000 (0:00:00.380) 0:02:01.131 **** ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Wednesday 03 December 2025 10:52:12 +0000 (0:00:01.118) 0:02:02.249 **** changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Wednesday 03 December 2025 10:52:12 +0000 (0:00:00.207) 0:02:02.456 **** changed: [instance] TASK [config_drive : Generate user-data] *************************************** Wednesday 03 December 2025 10:52:13 +0000 (0:00:00.357) 0:02:02.814 **** changed: [instance] TASK [config_drive : Generate network-data] ************************************ Wednesday 03 December 2025 10:52:13 +0000 (0:00:00.367) 0:02:03.181 **** skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Wednesday 03 December 2025 10:52:13 +0000 (0:00:00.042) 0:02:03.224 **** ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Wednesday 03 December 2025 10:52:13 +0000 (0:00:00.203) 0:02:03.427 **** skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Wednesday 03 December 2025 10:52:13 +0000 (0:00:00.043) 0:02:03.471 **** Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Wednesday 03 December 2025 10:52:13 +0000 (0:00:00.235) 0:02:03.707 **** changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Wednesday 03 December 2025 10:52:14 +0000 (0:00:00.274) 0:02:03.982 **** skipping: [instance] TASK [libvirt_manager : Configure boot order for controller-0] ***************** Wednesday 03 December 2025 10:52:14 +0000 (0:00:00.046) 0:02:04.029 **** skipping: [instance] TASK [libvirt_manager : Create VM image for crc-0] ***************************** Wednesday 03 December 2025 10:52:14 +0000 (0:00:00.027) 0:02:04.056 **** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ Wednesday 03 December 2025 10:52:14 +0000 (0:00:00.236) 0:02:04.293 **** changed: [instance] TASK [libvirt_manager : Define VMs for type crc-0] ***************************** Wednesday 03 December 2025 10:52:14 +0000 (0:00:00.213) 0:02:04.507 **** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** Wednesday 03 December 2025 10:52:15 +0000 (0:00:00.284) 0:02:04.791 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Wednesday 03 December 2025 10:52:15 +0000 (0:00:00.030) 0:02:04.821 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Wednesday 03 December 2025 10:52:15 +0000 (0:00:00.043) 0:02:04.865 **** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Wednesday 03 December 2025 10:52:15 +0000 (0:00:00.226) 0:02:05.092 **** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Wednesday 03 December 2025 10:52:15 +0000 (0:00:00.044) 0:02:05.136 **** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Wednesday 03 December 2025 10:52:15 +0000 (0:00:00.221) 0:02:05.358 **** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** Wednesday 03 December 2025 10:52:15 +0000 (0:00:00.191) 0:02:05.549 **** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Wednesday 03 December 2025 10:52:16 +0000 (0:00:00.273) 0:02:05.823 **** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Wednesday 03 December 2025 10:52:16 +0000 (0:00:00.222) 0:02:06.046 **** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Wednesday 03 December 2025 10:52:16 +0000 (0:00:00.042) 0:02:06.089 **** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Wednesday 03 December 2025 10:52:16 +0000 (0:00:00.221) 0:02:06.310 **** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* Wednesday 03 December 2025 10:52:16 +0000 (0:00:00.198) 0:02:06.509 **** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* Wednesday 03 December 2025 10:52:17 +0000 (0:00:00.276) 0:02:06.786 **** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ Wednesday 03 December 2025 10:52:17 +0000 (0:00:00.021) 0:02:06.807 **** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** Wednesday 03 December 2025 10:52:17 +0000 (0:00:00.026) 0:02:06.834 **** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** Wednesday 03 December 2025 10:52:17 +0000 (0:00:00.025) 0:02:06.859 **** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Wednesday 03 December 2025 10:52:17 +0000 (0:00:00.025) 0:02:06.885 **** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Wednesday 03 December 2025 10:52:18 +0000 (0:00:01.208) 0:02:08.093 **** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Wednesday 03 December 2025 10:52:18 +0000 (0:00:00.037) 0:02:08.131 **** skipping: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Wednesday 03 December 2025 10:52:18 +0000 (0:00:00.026) 0:02:08.157 **** skipping: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Wednesday 03 December 2025 10:52:18 +0000 (0:00:00.026) 0:02:08.183 **** skipping: [instance] TASK [libvirt_manager : Configure boot order for crc-0] ************************ Wednesday 03 December 2025 10:52:18 +0000 (0:00:00.042) 0:02:08.226 **** skipping: [instance] TASK [libvirt_manager : Start (power-on) VMs] ********************************** Wednesday 03 December 2025 10:52:18 +0000 (0:00:00.025) 0:02:08.252 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** Wednesday 03 December 2025 10:52:18 +0000 (0:00:00.057) 0:02:08.310 **** ok: [instance] => (item=crc) TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** Wednesday 03 December 2025 10:52:18 +0000 (0:00:00.234) 0:02:08.544 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Start vm] ********************************************** Wednesday 03 December 2025 10:52:20 +0000 (0:00:02.067) 0:02:10.612 **** changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Wednesday 03 December 2025 10:52:21 +0000 (0:00:00.801) 0:02:11.414 **** changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Wednesday 03 December 2025 10:52:22 +0000 (0:00:00.806) 0:02:12.221 **** changed: [instance] TASK [libvirt_manager : Wait for SSH on started VMs] *************************** Wednesday 03 December 2025 10:52:23 +0000 (0:00:00.814) 0:02:13.035 **** changed: [instance] => (item=compute-0.utility) changed: [instance] => (item=controller-0.utility) changed: [instance] => (item=crc-0.utility) TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** Wednesday 03 December 2025 10:52:23 +0000 (0:00:00.701) 0:02:13.737 **** FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j829236319187.24118', 'results_file': '/home/zuul/.ansible_async/j829236319187.24118', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j368586144579.24136', 'results_file': '/home/zuul/.ansible_async/j368586144579.24136', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j456875686975.24152', 'results_file': '/home/zuul/.ansible_async/j456875686975.24152', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) TASK [libvirt_manager : Configure managed VMs] ********************************* Wednesday 03 December 2025 10:52:43 +0000 (0:00:19.838) 0:02:33.575 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [Check if new ssh keypair exists] ***************************************** Wednesday 03 December 2025 10:52:43 +0000 (0:00:00.132) 0:02:33.708 **** skipping: [instance] TASK [Push ssh jumper/configuration for compute-0] ***************************** Wednesday 03 December 2025 10:52:43 +0000 (0:00:00.033) 0:02:33.741 **** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Wednesday 03 December 2025 10:52:44 +0000 (0:00:00.044) 0:02:33.786 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Wednesday 03 December 2025 10:52:44 +0000 (0:00:00.088) 0:02:33.874 **** changed: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Wednesday 03 December 2025 10:52:44 +0000 (0:00:00.239) 0:02:34.114 **** changed: [instance] TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* Wednesday 03 December 2025 10:52:44 +0000 (0:00:00.242) 0:02:34.356 **** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** Wednesday 03 December 2025 10:52:45 +0000 (0:00:00.414) 0:02:34.770 **** skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Wednesday 03 December 2025 10:52:45 +0000 (0:00:00.037) 0:02:34.808 **** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** Wednesday 03 December 2025 10:52:45 +0000 (0:00:00.039) 0:02:34.848 **** skipping: [instance] TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** Wednesday 03 December 2025 10:52:45 +0000 (0:00:00.061) 0:02:34.909 **** skipping: [instance] TASK [Check if new ssh keypair exists] ***************************************** Wednesday 03 December 2025 10:52:45 +0000 (0:00:00.054) 0:02:34.964 **** skipping: [instance] TASK [Push ssh jumper/configuration for controller-0] ************************** Wednesday 03 December 2025 10:52:45 +0000 (0:00:00.028) 0:02:34.992 **** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Wednesday 03 December 2025 10:52:45 +0000 (0:00:00.040) 0:02:35.033 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Wednesday 03 December 2025 10:52:45 +0000 (0:00:00.097) 0:02:35.131 **** ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Wednesday 03 December 2025 10:52:45 +0000 (0:00:00.247) 0:02:35.378 **** ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** Wednesday 03 December 2025 10:52:45 +0000 (0:00:00.214) 0:02:35.592 **** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** Wednesday 03 December 2025 10:52:46 +0000 (0:00:00.402) 0:02:35.995 **** skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Wednesday 03 December 2025 10:52:46 +0000 (0:00:00.030) 0:02:36.026 **** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts controller-0] ************** Wednesday 03 December 2025 10:52:46 +0000 (0:00:00.032) 0:02:36.059 **** changed: [instance -> controller-0.instance] TASK [libvirt_manager : Inject public key on hosts controller-0] *************** Wednesday 03 December 2025 10:52:47 +0000 (0:00:01.625) 0:02:37.685 **** changed: [instance -> controller-0.instance] TASK [Check if new ssh keypair exists] ***************************************** Wednesday 03 December 2025 10:52:49 +0000 (0:00:01.161) 0:02:38.846 **** TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Wednesday 03 December 2025 10:52:49 +0000 (0:00:00.038) 0:02:38.885 **** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Wednesday 03 December 2025 10:52:49 +0000 (0:00:00.258) 0:02:39.143 **** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Wednesday 03 December 2025 10:52:49 +0000 (0:00:00.032) 0:02:39.176 **** skipping: [instance] TASK [Push ssh jumper/configuration for crc-0] ********************************* Wednesday 03 December 2025 10:52:49 +0000 (0:00:00.040) 0:02:39.217 **** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Wednesday 03 December 2025 10:52:49 +0000 (0:00:00.053) 0:02:39.271 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Wednesday 03 December 2025 10:52:49 +0000 (0:00:00.153) 0:02:39.424 **** ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Wednesday 03 December 2025 10:52:49 +0000 (0:00:00.294) 0:02:39.719 **** ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** Wednesday 03 December 2025 10:52:50 +0000 (0:00:00.232) 0:02:39.952 **** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** Wednesday 03 December 2025 10:52:50 +0000 (0:00:00.425) 0:02:40.377 **** changed: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Wednesday 03 December 2025 10:52:51 +0000 (0:00:00.981) 0:02:41.358 **** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* Wednesday 03 December 2025 10:52:51 +0000 (0:00:00.035) 0:02:41.393 **** skipping: [instance] TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** Wednesday 03 December 2025 10:52:51 +0000 (0:00:00.055) 0:02:41.448 **** skipping: [instance] TASK [Create VBMC entity] ****************************************************** Wednesday 03 December 2025 10:52:51 +0000 (0:00:00.046) 0:02:41.495 **** skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) skipping: [instance] TASK [libvirt_manager : List running virtual machines.] ************************ Wednesday 03 December 2025 10:52:51 +0000 (0:00:00.052) 0:02:41.548 **** ok: [instance] TASK [libvirt_manager : Dump UUIDs] ******************************************** Wednesday 03 December 2025 10:52:52 +0000 (0:00:00.245) 0:02:41.794 **** changed: [instance] TASK [Ensure fresh vbmc listing] *********************************************** Wednesday 03 December 2025 10:52:52 +0000 (0:00:00.373) 0:02:42.167 **** skipping: [instance] TASK [libvirt_manager : Update vbmc related fact] ****************************** Wednesday 03 December 2025 10:52:52 +0000 (0:00:00.047) 0:02:42.215 **** skipping: [instance] TASK [libvirt_manager : Dump vbmc known hosts] ********************************* Wednesday 03 December 2025 10:52:52 +0000 (0:00:00.036) 0:02:42.251 **** skipping: [instance] TASK [libvirt_manager : Copy authorized_keys] ********************************** Wednesday 03 December 2025 10:52:52 +0000 (0:00:00.031) 0:02:42.282 **** changed: [instance] TASK [libvirt_manager : Enable root access on CRC] ***************************** Wednesday 03 December 2025 10:52:53 +0000 (0:00:00.651) 0:02:42.934 **** changed: [instance] TASK [reproducer : Get deployed VM group inventories] ************************** Wednesday 03 December 2025 10:52:53 +0000 (0:00:00.650) 0:02:43.585 **** skipping: [instance] TASK [reproducer : Inject remote inventories onto main hypervisor] ************* Wednesday 03 December 2025 10:52:53 +0000 (0:00:00.043) 0:02:43.629 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) TASK [reproducer : Gather inventories from instance] *************************** Wednesday 03 December 2025 10:52:53 +0000 (0:00:00.064) 0:02:43.693 **** skipping: [instance] TASK [reproducer : Gather inventories from compute-0] ************************** Wednesday 03 December 2025 10:52:53 +0000 (0:00:00.043) 0:02:43.737 **** skipping: [instance] TASK [reproducer : Gather inventories from controller-0] *********************** Wednesday 03 December 2025 10:52:54 +0000 (0:00:00.035) 0:02:43.773 **** skipping: [instance] TASK [reproducer : Gather inventories from crc-0] ****************************** Wednesday 03 December 2025 10:52:54 +0000 (0:00:00.055) 0:02:43.828 **** skipping: [instance] TASK [reproducer : Push generated inventory from hypervisor] ******************* Wednesday 03 December 2025 10:52:54 +0000 (0:00:00.046) 0:02:43.875 **** changed: [instance] TASK [reproducer : Slurp devscripts private key] ******************************* Wednesday 03 December 2025 10:52:54 +0000 (0:00:00.677) 0:02:44.552 **** skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** Wednesday 03 December 2025 10:52:54 +0000 (0:00:00.041) 0:02:44.594 **** skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* Wednesday 03 December 2025 10:52:54 +0000 (0:00:00.037) 0:02:44.631 **** skipping: [instance] TASK [openshift_login : Assert we have needed parameters] ********************** Wednesday 03 December 2025 10:52:54 +0000 (0:00:00.039) 0:02:44.670 **** skipping: [instance] TASK [openshift_login : Stat kubeconfig] *************************************** Wednesday 03 December 2025 10:52:54 +0000 (0:00:00.036) 0:02:44.706 **** skipping: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Wednesday 03 December 2025 10:52:54 +0000 (0:00:00.033) 0:02:44.740 **** skipping: [instance] TASK [openshift_login : Assert files exist] ************************************ Wednesday 03 December 2025 10:52:55 +0000 (0:00:00.035) 0:02:44.776 **** skipping: [instance] TASK [openshift_login : Gather the password of the deployed cluster.] ********** Wednesday 03 December 2025 10:52:55 +0000 (0:00:00.039) 0:02:44.816 **** skipping: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Wednesday 03 December 2025 10:52:55 +0000 (0:00:00.041) 0:02:44.858 **** skipping: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Wednesday 03 December 2025 10:52:55 +0000 (0:00:00.041) 0:02:44.899 **** skipping: [instance] TASK [reproducer : Set fact for later wait on OCP cluster] ********************* Wednesday 03 December 2025 10:52:55 +0000 (0:00:00.045) 0:02:44.945 **** skipping: [instance] TASK [reproducer : Configure Controller node] ********************************** Wednesday 03 December 2025 10:52:55 +0000 (0:00:00.035) 0:02:44.980 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance TASK [reproducer : Ensure directories exist] *********************************** Wednesday 03 December 2025 10:52:55 +0000 (0:00:00.159) 0:02:45.140 **** changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Tweak dnf configuration] ************************************ Wednesday 03 December 2025 10:52:56 +0000 (0:00:01.489) 0:02:46.629 **** skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Wednesday 03 December 2025 10:52:56 +0000 (0:00:00.028) 0:02:46.657 **** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Wednesday 03 December 2025 10:52:57 +0000 (0:00:00.658) 0:02:47.316 **** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Wednesday 03 December 2025 10:52:57 +0000 (0:00:00.045) 0:02:47.361 **** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Wednesday 03 December 2025 10:52:57 +0000 (0:00:00.040) 0:02:47.401 **** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Wednesday 03 December 2025 10:52:57 +0000 (0:00:00.045) 0:02:47.447 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get rhos-release] ******************************************* Wednesday 03 December 2025 10:52:59 +0000 (0:00:01.654) 0:02:49.102 **** skipping: [instance] TASK [reproducer : Install repos] ********************************************** Wednesday 03 December 2025 10:52:59 +0000 (0:00:00.038) 0:02:49.141 **** skipping: [instance] TASK [reproducer : Run custom commands after rhos-release setup] *************** Wednesday 03 December 2025 10:52:59 +0000 (0:00:00.035) 0:02:49.177 **** skipping: [instance] TASK [reproducer : Create bundle for CRC] ************************************** Wednesday 03 December 2025 10:52:59 +0000 (0:00:00.043) 0:02:49.220 **** skipping: [instance] TASK [reproducer : Install some tools] ***************************************** Wednesday 03 December 2025 10:52:59 +0000 (0:00:00.037) 0:02:49.257 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject command aliases for faster debugging] **************** Wednesday 03 December 2025 10:53:00 +0000 (0:00:01.222) 0:02:50.479 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Build job inventory for hook usage] ************************* Wednesday 03 December 2025 10:53:01 +0000 (0:00:01.176) 0:02:51.656 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Push the MAC mapping data] ********************************** Wednesday 03 December 2025 10:53:02 +0000 (0:00:00.655) 0:02:52.312 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject other Hypervisor SSH keys] *************************** Wednesday 03 December 2025 10:53:03 +0000 (0:00:01.067) 0:02:53.379 **** changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** Wednesday 03 December 2025 10:53:04 +0000 (0:00:01.366) 0:02:54.745 **** changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject SSH configuration] *********************************** Wednesday 03 December 2025 10:53:05 +0000 (0:00:00.684) 0:02:55.430 **** skipping: [instance] => (item=instance) changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) TASK [reproducer : Create kube directory] ************************************** Wednesday 03 December 2025 10:53:07 +0000 (0:00:01.753) 0:02:57.183 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeconfig content] ********************************** Wednesday 03 December 2025 10:53:08 +0000 (0:00:00.667) 0:02:57.851 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeadmin-password if exists] ************************ Wednesday 03 December 2025 10:53:09 +0000 (0:00:01.078) 0:02:58.929 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject devscripts private key if set] *********************** Wednesday 03 December 2025 10:53:10 +0000 (0:00:01.011) 0:02:59.940 **** skipping: [instance] TASK [reproducer : Ensure /etc/ci/env is created] ****************************** Wednesday 03 December 2025 10:53:10 +0000 (0:00:00.043) 0:02:59.984 **** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Ensure directory tree exist] **************************** Wednesday 03 December 2025 10:53:10 +0000 (0:00:00.632) 0:03:00.616 **** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Assert we get needed data] ****************************** Wednesday 03 December 2025 10:53:11 +0000 (0:00:00.589) 0:03:01.206 **** ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Push reproducer secrets] ******************************** Wednesday 03 December 2025 10:53:11 +0000 (0:00:00.045) 0:03:01.251 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) TASK [manage_secrets : Debug _secret_dest] ************************************* Wednesday 03 December 2025 10:53:11 +0000 (0:00:00.076) 0:03:01.327 **** ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt TASK [manage_secrets : Debug _secret_file] ************************************* Wednesday 03 December 2025 10:53:11 +0000 (0:00:00.060) 0:03:01.387 **** ok: [instance -> controller-0(controller-0.instance)] => _secret_file: '' TASK [manage_secrets : Debug _secret_content] ********************************** Wednesday 03 December 2025 10:53:11 +0000 (0:00:00.062) 0:03:01.450 **** ok: [instance -> controller-0(controller-0.instance)] => _secret_content: my-default-location-place TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Wednesday 03 December 2025 10:53:11 +0000 (0:00:00.054) 0:03:01.504 **** skipping: [instance] TASK [manage_secrets : Check if pull secret src file exists] ******************* Wednesday 03 December 2025 10:53:11 +0000 (0:00:00.065) 0:03:01.570 **** skipping: [instance] TASK [manage_secrets : Copy file to location] ********************************** Wednesday 03 December 2025 10:53:11 +0000 (0:00:00.057) 0:03:01.627 **** skipping: [instance] TASK [manage_secrets : Create file from content] ******************************* Wednesday 03 December 2025 10:53:11 +0000 (0:00:00.054) 0:03:01.682 **** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Debug _secret_dest] ************************************* Wednesday 03 December 2025 10:53:13 +0000 (0:00:01.102) 0:03:02.784 **** ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ipmi-things TASK [manage_secrets : Debug _secret_file] ************************************* Wednesday 03 December 2025 10:53:13 +0000 (0:00:00.056) 0:03:02.841 **** ok: [instance -> controller-0(controller-0.instance)] => _secret_file: /tmp/ipmi-things TASK [manage_secrets : Debug _secret_content] ********************************** Wednesday 03 December 2025 10:53:13 +0000 (0:00:00.064) 0:03:02.905 **** ok: [instance -> controller-0(controller-0.instance)] => _secret_content: '' TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Wednesday 03 December 2025 10:53:13 +0000 (0:00:00.052) 0:03:02.957 **** ok: [instance -> controller-0(controller-0.instance)] => changed=false msg: All assertions passed TASK [manage_secrets : Check if pull secret src file exists] ******************* Wednesday 03 December 2025 10:53:13 +0000 (0:00:00.070) 0:03:03.027 **** ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Copy file to location] ********************************** Wednesday 03 December 2025 10:53:13 +0000 (0:00:00.644) 0:03:03.672 **** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Create file from content] ******************************* Wednesday 03 December 2025 10:53:14 +0000 (0:00:01.028) 0:03:04.701 **** skipping: [instance] TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** Wednesday 03 December 2025 10:53:15 +0000 (0:00:00.060) 0:03:04.761 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check if async file is still available] ********************* Wednesday 03 December 2025 10:53:15 +0000 (0:00:00.627) 0:03:05.388 **** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check package install status] ******************************* Wednesday 03 December 2025 10:53:16 +0000 (0:00:00.719) 0:03:06.108 **** FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** Wednesday 03 December 2025 10:54:12 +0000 (0:00:56.393) 0:04:02.502 **** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Install required packages] ****************************** Wednesday 03 December 2025 10:54:13 +0000 (0:00:00.697) 0:04:03.199 **** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get ingresses domain] *********************************** Wednesday 03 December 2025 10:54:16 +0000 (0:00:03.135) 0:04:06.335 **** skipping: [instance] TASK [sushy_emulator : Set sushy url for ocp installation] ********************* Wednesday 03 December 2025 10:54:16 +0000 (0:00:00.056) 0:04:06.392 **** skipping: [instance] TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** Wednesday 03 December 2025 10:54:16 +0000 (0:00:00.058) 0:04:06.450 **** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp private ssh key for later use] ******************** Wednesday 03 December 2025 10:54:17 +0000 (0:00:00.801) 0:04:07.252 **** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* Wednesday 03 December 2025 10:54:18 +0000 (0:00:00.671) 0:04:07.924 **** changed: [instance] TASK [sushy_emulator : Run ssh-keyscan] **************************************** Wednesday 03 December 2025 10:54:18 +0000 (0:00:00.363) 0:04:08.288 **** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write known hosts for later use] ************************ Wednesday 03 December 2025 10:54:19 +0000 (0:00:00.699) 0:04:08.988 **** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Wednesday 03 December 2025 10:54:20 +0000 (0:00:01.096) 0:04:10.084 **** skipping: [instance] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Wednesday 03 December 2025 10:54:20 +0000 (0:00:00.048) 0:04:10.133 **** skipping: [instance] TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Wednesday 03 December 2025 10:54:20 +0000 (0:00:00.048) 0:04:10.181 **** skipping: [instance] TASK [sushy_emulator : Generate list of filtered VMs] ************************** Wednesday 03 December 2025 10:54:20 +0000 (0:00:00.042) 0:04:10.224 **** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** Wednesday 03 December 2025 10:54:20 +0000 (0:00:00.062) 0:04:10.286 **** skipping: [instance] TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** Wednesday 03 December 2025 10:54:20 +0000 (0:00:00.044) 0:04:10.331 **** skipping: [instance] TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** Wednesday 03 December 2025 10:54:20 +0000 (0:00:00.044) 0:04:10.375 **** skipping: [instance] TASK [sushy_emulator : Generate htpasswd string] ******************************* Wednesday 03 December 2025 10:54:20 +0000 (0:00:00.045) 0:04:10.420 **** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write sushy emulator resource loop] ********************* Wednesday 03 December 2025 10:54:21 +0000 (0:00:00.740) 0:04:11.161 **** skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=pod) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Write sushy emulator config] **************************** Wednesday 03 December 2025 10:54:21 +0000 (0:00:00.108) 0:04:11.270 **** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write htpasswd string to file] ************************** Wednesday 03 December 2025 10:54:22 +0000 (0:00:01.143) 0:04:12.413 **** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** Wednesday 03 December 2025 10:54:23 +0000 (0:00:01.125) 0:04:13.538 **** skipping: [instance] TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** Wednesday 03 December 2025 10:54:23 +0000 (0:00:00.049) 0:04:13.588 **** skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* Wednesday 03 December 2025 10:54:23 +0000 (0:00:00.049) 0:04:13.638 **** skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** Wednesday 03 December 2025 10:54:23 +0000 (0:00:00.086) 0:04:13.724 **** skipping: [instance] TASK [podman : Ensure podman is installed] ************************************* Wednesday 03 December 2025 10:54:24 +0000 (0:00:00.048) 0:04:13.773 **** ok: [instance -> controller-0(controller-0.instance)] TASK [podman : Enable loginctl linger for ansible_user_id] ********************* Wednesday 03 December 2025 10:54:25 +0000 (0:00:01.657) 0:04:15.430 **** changed: [instance -> controller-0(controller-0.instance)] TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* Wednesday 03 December 2025 10:54:26 +0000 (0:00:00.931) 0:04:16.362 **** skipping: [instance] TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* Wednesday 03 December 2025 10:54:26 +0000 (0:00:00.054) 0:04:16.416 **** skipping: [instance] TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** Wednesday 03 December 2025 10:54:26 +0000 (0:00:00.060) 0:04:16.476 **** skipping: [instance] TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** Wednesday 03 December 2025 10:54:26 +0000 (0:00:00.052) 0:04:16.529 **** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create and start Sushy Emulator container] ************** Wednesday 03 December 2025 10:54:37 +0000 (0:00:11.129) 0:04:27.659 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure directories exist] *********************************** Wednesday 03 December 2025 10:54:39 +0000 (0:00:01.464) 0:04:29.124 **** ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Convert VBMC list into a dict for better usage] ************* Wednesday 03 December 2025 10:54:40 +0000 (0:00:01.243) 0:04:30.368 **** skipping: [instance] TASK [reproducer : Check if baremetal-info.yml exists] ************************* Wednesday 03 December 2025 10:54:40 +0000 (0:00:00.048) 0:04:30.416 **** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get content of baremetal-info file] ************************* Wednesday 03 December 2025 10:54:41 +0000 (0:00:00.674) 0:04:31.091 **** skipping: [instance] TASK [reproducer : Interpret remote file content as yaml] ********************** Wednesday 03 December 2025 10:54:41 +0000 (0:00:00.038) 0:04:31.129 **** skipping: [instance] TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Wednesday 03 December 2025 10:54:41 +0000 (0:00:00.041) 0:04:31.171 **** skipping: [instance] TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Wednesday 03 December 2025 10:54:41 +0000 (0:00:00.048) 0:04:31.219 **** skipping: [instance] TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** Wednesday 03 December 2025 10:54:41 +0000 (0:00:00.037) 0:04:31.257 **** ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '6b0ac32b-3223-4bcf-afd9-6c6e8c01d459'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '9a852344-ece2-4e0c-8109-f1e09dad938c'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': 'c1b7f31f-bf9a-45ab-98bf-c17be78b883e'}) TASK [reproducer : Output baremetal info file] ********************************* Wednesday 03 December 2025 10:54:41 +0000 (0:00:00.143) 0:04:31.401 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Output ironic_nodes to file] ******************************** Wednesday 03 December 2025 10:54:42 +0000 (0:00:01.216) 0:04:32.617 **** skipping: [instance] TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* Wednesday 03 December 2025 10:54:42 +0000 (0:00:00.053) 0:04:32.670 **** TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** Wednesday 03 December 2025 10:54:43 +0000 (0:00:00.134) 0:04:32.804 **** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Wednesday 03 December 2025 10:54:43 +0000 (0:00:00.053) 0:04:32.858 **** skipping: [instance] TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Wednesday 03 December 2025 10:54:43 +0000 (0:00:00.049) 0:04:32.907 **** skipping: [instance] TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** Wednesday 03 December 2025 10:54:43 +0000 (0:00:00.043) 0:04:32.951 **** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** Wednesday 03 December 2025 10:54:44 +0000 (0:00:01.438) 0:04:34.390 **** ok: [instance -> controller-0(controller-0.instance)] => (item=6b0ac32b-3223-4bcf-afd9-6c6e8c01d459) ok: [instance -> controller-0(controller-0.instance)] => (item=9a852344-ece2-4e0c-8109-f1e09dad938c) ok: [instance -> controller-0(controller-0.instance)] => (item=c1b7f31f-bf9a-45ab-98bf-c17be78b883e) TASK [sushy_emulator : Verify baremetal VM power status] *********************** Wednesday 03 December 2025 10:54:49 +0000 (0:00:05.275) 0:04:39.665 **** ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** Wednesday 03 December 2025 10:54:50 +0000 (0:00:00.108) 0:04:39.774 **** ok: [instance -> localhost] TASK [reproducer : Sync local repositories to other hosts if present] ********** Wednesday 03 December 2025 10:54:50 +0000 (0:00:00.235) 0:04:40.010 **** changed: [instance -> localhost] => (item=controller-0) TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** Wednesday 03 December 2025 10:54:52 +0000 (0:00:02.108) 0:04:42.118 **** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install ansible dependencies] ******************************* Wednesday 03 December 2025 10:54:53 +0000 (0:00:00.646) 0:04:42.765 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** Wednesday 03 December 2025 10:54:53 +0000 (0:00:00.774) 0:04:43.539 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** Wednesday 03 December 2025 10:54:54 +0000 (0:00:01.159) 0:04:44.699 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject local environment parameters] ************************ Wednesday 03 December 2025 10:54:55 +0000 (0:00:00.659) 0:04:45.359 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create openshift-environment.yml symlink to old location] *** Wednesday 03 December 2025 10:54:56 +0000 (0:00:01.074) 0:04:46.433 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get interfaces-info content] ******************************** Wednesday 03 December 2025 10:54:57 +0000 (0:00:00.619) 0:04:47.053 **** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Wait for OCP nodes to be ready] ***************************** Wednesday 03 December 2025 10:54:57 +0000 (0:00:00.613) 0:04:47.666 **** ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) TASK [networking_mapper : Check for Networking Definition file existence] ****** Wednesday 03 December 2025 10:54:59 +0000 (0:00:01.326) 0:04:48.993 **** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Wednesday 03 December 2025 10:54:59 +0000 (0:00:00.037) 0:04:49.030 **** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Wednesday 03 December 2025 10:54:59 +0000 (0:00:00.035) 0:04:49.066 **** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Wednesday 03 December 2025 10:54:59 +0000 (0:00:00.039) 0:04:49.105 **** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Wednesday 03 December 2025 10:54:59 +0000 (0:00:00.034) 0:04:49.140 **** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Wednesday 03 December 2025 10:54:59 +0000 (0:00:00.035) 0:04:49.175 **** ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) ok: [instance -> controller-0(controller-0.instance)] => (item={}) TASK [networking_mapper : Gather facts if requested] *************************** Wednesday 03 December 2025 10:54:59 +0000 (0:00:00.100) 0:04:49.275 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance TASK [networking_mapper : Gather the facts] ************************************ Wednesday 03 December 2025 10:54:59 +0000 (0:00:00.048) 0:04:49.324 **** ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** Wednesday 03 December 2025 10:55:02 +0000 (0:00:03.258) 0:04:52.583 **** changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Wednesday 03 December 2025 10:55:03 +0000 (0:00:01.171) 0:04:53.754 **** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Definition to file] ************* Wednesday 03 December 2025 10:55:04 +0000 (0:00:00.488) 0:04:54.243 **** changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Call the networking mapper] ************************** Wednesday 03 December 2025 10:55:05 +0000 (0:00:00.897) 0:04:55.140 **** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set networking mapper facts] ************************* Wednesday 03 December 2025 10:55:05 +0000 (0:00:00.081) 0:04:55.221 **** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Wednesday 03 December 2025 10:55:05 +0000 (0:00:00.052) 0:04:55.274 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CRC ssh key] ***************************************** Wednesday 03 December 2025 10:55:06 +0000 (0:00:00.989) 0:04:56.264 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure we have all dependencies installed] ****************** Wednesday 03 December 2025 10:55:07 +0000 (0:00:00.923) 0:04:57.187 **** FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [Configure ntp service] *************************************************** Wednesday 03 December 2025 10:55:13 +0000 (0:00:05.970) 0:05:03.157 **** TASK [cifmw_ntp : Install chrony] ********************************************** Wednesday 03 December 2025 10:55:13 +0000 (0:00:00.209) 0:05:03.367 **** ok: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Configure original chrony.conf file] ************************* Wednesday 03 December 2025 10:55:14 +0000 (0:00:00.943) 0:05:04.311 **** ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) TASK [cifmw_ntp : Render chrony extra config file] ***************************** Wednesday 03 December 2025 10:55:15 +0000 (0:00:00.977) 0:05:05.289 **** changed: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Enable chrony service] *************************************** Wednesday 03 December 2025 10:55:16 +0000 (0:00:01.010) 0:05:06.299 **** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Configure CRC node if available] **************************** Wednesday 03 December 2025 10:55:17 +0000 (0:00:00.653) 0:05:06.952 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance TASK [reproducer : Get the networking-environment-definition from controller-0] *** Wednesday 03 December 2025 10:55:17 +0000 (0:00:00.203) 0:05:07.156 **** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check which dnsmasq config we must edit] ******************** Wednesday 03 December 2025 10:55:17 +0000 (0:00:00.524) 0:05:07.681 **** ok: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Configure local DNS for CRC pod] **************************** Wednesday 03 December 2025 10:55:18 +0000 (0:00:00.536) 0:05:08.218 **** changed: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** Wednesday 03 December 2025 10:55:19 +0000 (0:00:00.654) 0:05:08.873 **** changed: [instance -> crc-0(crc-0.instance)] TASK [Restart DNS in CRC VM] *************************************************** Wednesday 03 December 2025 10:55:19 +0000 (0:00:00.601) 0:05:09.475 **** TASK [openshift_setup : Check which dnsmasq config we must edit] *************** Wednesday 03 December 2025 10:55:19 +0000 (0:00:00.060) 0:05:09.535 **** ok: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Restart dnsmasq service if used] *********************** Wednesday 03 December 2025 10:55:20 +0000 (0:00:00.502) 0:05:10.038 **** changed: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Stop dnsmasq] ****************************************** Wednesday 03 December 2025 10:55:21 +0000 (0:00:00.773) 0:05:10.811 **** skipping: [instance] TASK [openshift_setup : Start dnsmasq] ***************************************** Wednesday 03 December 2025 10:55:21 +0000 (0:00:00.039) 0:05:10.850 **** skipping: [instance] TASK [reproducer : Remove entry from /etc/hosts] ******************************* Wednesday 03 December 2025 10:55:21 +0000 (0:00:00.042) 0:05:10.892 **** changed: [instance] TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** Wednesday 03 December 2025 10:55:21 +0000 (0:00:00.259) 0:05:11.152 **** skipping: [instance] => (item=) TASK [dnsmasq : Assert we have needed address data] **************************** Wednesday 03 December 2025 10:55:21 +0000 (0:00:00.077) 0:05:11.229 **** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Wednesday 03 December 2025 10:55:21 +0000 (0:00:00.035) 0:05:11.265 **** ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Wednesday 03 December 2025 10:55:21 +0000 (0:00:00.072) 0:05:11.337 **** changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ Wednesday 03 December 2025 10:55:21 +0000 (0:00:00.257) 0:05:11.595 **** TASK [dnsmasq : Assert we have needed host record data] ************************ Wednesday 03 December 2025 10:55:21 +0000 (0:00:00.047) 0:05:11.643 **** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Wednesday 03 December 2025 10:55:21 +0000 (0:00:00.065) 0:05:11.708 **** ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Wednesday 03 December 2025 10:55:22 +0000 (0:00:00.062) 0:05:11.770 **** changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [reproducer : Ensure "testing" domain is "local"] ************************* Wednesday 03 December 2025 10:55:22 +0000 (0:00:00.284) 0:05:12.055 **** changed: [instance] TASK [reproducer : Flush handlers] ********************************************* Wednesday 03 December 2025 10:55:22 +0000 (0:00:00.466) 0:05:12.521 **** RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** Wednesday 03 December 2025 10:55:22 +0000 (0:00:00.011) 0:05:12.533 **** changed: [instance -> controller-0(controller-0.instance)] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Wednesday 03 December 2025 10:55:23 +0000 (0:00:00.682) 0:05:13.215 **** changed: [instance] TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** Wednesday 03 December 2025 10:55:23 +0000 (0:00:00.417) 0:05:13.633 **** skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** Wednesday 03 December 2025 10:55:24 +0000 (0:00:00.186) 0:05:13.820 **** changed: [instance -> compute-0(compute-0.instance)] TASK [reproducer : Tweak dnf configuration] ************************************ Wednesday 03 December 2025 10:55:25 +0000 (0:00:01.537) 0:05:15.357 **** skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Wednesday 03 December 2025 10:55:25 +0000 (0:00:00.026) 0:05:15.383 **** ok: [instance -> compute-0(compute-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Wednesday 03 December 2025 10:55:26 +0000 (0:00:00.535) 0:05:15.918 **** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Wednesday 03 December 2025 10:55:26 +0000 (0:00:00.045) 0:05:15.964 **** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Wednesday 03 December 2025 10:55:26 +0000 (0:00:00.048) 0:05:16.012 **** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Wednesday 03 December 2025 10:55:26 +0000 (0:00:00.043) 0:05:16.055 **** changed: [instance -> compute-0(compute-0.instance)] TASK [reproducer : Get rhos-release and setup repos] *************************** Wednesday 03 December 2025 10:55:27 +0000 (0:00:01.514) 0:05:17.570 **** skipping: [instance] TASK [reproducer : Create repositories on computes] **************************** Wednesday 03 December 2025 10:55:27 +0000 (0:00:00.037) 0:05:17.607 **** skipping: [instance] TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* Wednesday 03 December 2025 10:55:27 +0000 (0:00:00.020) 0:05:17.628 **** skipping: [instance] TASK [reproducer : Discover and expose CI Framework path on remote node] ******* Wednesday 03 December 2025 10:55:27 +0000 (0:00:00.029) 0:05:17.658 **** ok: [instance] TASK [reproducer : Push local code] ******************************************** Wednesday 03 December 2025 10:55:27 +0000 (0:00:00.054) 0:05:17.712 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance TASK [reproducer : Check if repository directories already exist] ************** Wednesday 03 December 2025 10:55:28 +0000 (0:00:00.097) 0:05:17.809 **** skipping: [instance] TASK [reproducer : Ensure we are not in the job_id branch] ********************* Wednesday 03 December 2025 10:55:28 +0000 (0:00:00.040) 0:05:17.850 **** skipping: [instance] TASK [reproducer : Fetch zuul.items repositories] ****************************** Wednesday 03 December 2025 10:55:28 +0000 (0:00:00.041) 0:05:17.892 **** skipping: [instance] TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** Wednesday 03 December 2025 10:55:28 +0000 (0:00:00.042) 0:05:17.934 **** skipping: [instance] TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** Wednesday 03 December 2025 10:55:28 +0000 (0:00:00.038) 0:05:17.973 **** skipping: [instance] TASK [reproducer : Create target directories beforehand] *********************** Wednesday 03 December 2025 10:55:28 +0000 (0:00:00.036) 0:05:18.009 **** ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) TASK [reproducer : Sync local repositories to ansible controller] ************** Wednesday 03 December 2025 10:55:28 +0000 (0:00:00.451) 0:05:18.460 **** ok: [instance -> localhost] => (item=ci-framework) TASK [reproducer : Sync remote repositories] *********************************** Wednesday 03 December 2025 10:55:29 +0000 (0:00:00.570) 0:05:19.030 **** skipping: [instance] => (item=ci-framework) skipping: [instance] TASK [reproducer : Ensure default repositories are present] ******************** Wednesday 03 December 2025 10:55:29 +0000 (0:00:00.045) 0:05:19.076 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) TASK [reproducer : Check repository availability: ci-framework] **************** Wednesday 03 December 2025 10:55:29 +0000 (0:00:00.076) 0:05:19.152 **** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: ci-framework] ******************* Wednesday 03 December 2025 10:55:29 +0000 (0:00:00.451) 0:05:19.604 **** skipping: [instance] TASK [reproducer : Check repository availability: install_yamls] *************** Wednesday 03 December 2025 10:55:29 +0000 (0:00:00.037) 0:05:19.641 **** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: install_yamls] ****************** Wednesday 03 December 2025 10:55:30 +0000 (0:00:00.471) 0:05:20.112 **** skipping: [instance] TASK [reproducer : Check repository availability: architecture] **************** Wednesday 03 December 2025 10:55:30 +0000 (0:00:00.038) 0:05:20.151 **** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: architecture] ******************* Wednesday 03 December 2025 10:55:30 +0000 (0:00:00.420) 0:05:20.571 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Sync local repositories to ansible controller] ************** Wednesday 03 December 2025 10:55:33 +0000 (0:00:02.238) 0:05:22.810 **** changed: [instance -> localhost] TASK [reproducer : Install collections on controller-0] ************************ Wednesday 03 December 2025 10:55:33 +0000 (0:00:00.788) 0:05:23.598 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CI Framework motd] *********************************** Wednesday 03 December 2025 10:55:53 +0000 (0:00:19.351) 0:05:42.950 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate some logs] ******************************************* Wednesday 03 December 2025 10:55:54 +0000 (0:00:01.091) 0:05:44.042 **** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* Wednesday 03 December 2025 10:55:54 +0000 (0:00:00.102) 0:05:44.145 **** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate log if present] ************************************** Wednesday 03 December 2025 10:55:54 +0000 (0:00:00.502) 0:05:44.647 **** skipping: [instance] TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** Wednesday 03 December 2025 10:55:54 +0000 (0:00:00.050) 0:05:44.697 **** skipping: [instance] TASK [cifmw_setup : Get customized parameters] ********************************* Wednesday 03 December 2025 10:55:54 +0000 (0:00:00.046) 0:05:44.744 **** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Ensure target directory exists] ***************************** Wednesday 03 December 2025 10:55:55 +0000 (0:00:00.093) 0:05:44.838 **** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Wednesday 03 December 2025 10:55:55 +0000 (0:00:00.554) 0:05:45.393 **** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Wednesday 03 December 2025 10:55:55 +0000 (0:00:00.046) 0:05:45.439 **** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Wednesday 03 December 2025 10:55:55 +0000 (0:00:00.044) 0:05:45.484 **** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Wednesday 03 December 2025 10:55:55 +0000 (0:00:00.043) 0:05:45.527 **** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Ensure directories are present] ***************************** Wednesday 03 December 2025 10:55:57 +0000 (0:00:01.541) 0:05:47.068 **** changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [repo_setup : Make sure git-core package is installed] ******************** Wednesday 03 December 2025 10:55:58 +0000 (0:00:01.591) 0:05:48.659 **** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Get repo-setup repository] ********************************** Wednesday 03 December 2025 10:55:59 +0000 (0:00:01.047) 0:05:49.707 **** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Initialize python venv and install requirements] ************ Wednesday 03 December 2025 10:56:01 +0000 (0:00:01.304) 0:05:51.011 **** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Install repo-setup package] ********************************* Wednesday 03 December 2025 10:56:09 +0000 (0:00:08.026) 0:05:59.038 **** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Wednesday 03 December 2025 10:56:10 +0000 (0:00:01.120) 0:06:00.158 **** skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Wednesday 03 December 2025 10:56:10 +0000 (0:00:00.052) 0:06:00.210 **** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Get component repo] ***************************************** Wednesday 03 December 2025 10:56:11 +0000 (0:00:01.213) 0:06:01.424 **** skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Wednesday 03 December 2025 10:56:11 +0000 (0:00:00.068) 0:06:01.493 **** skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Wednesday 03 December 2025 10:56:11 +0000 (0:00:00.062) 0:06:01.556 **** skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Wednesday 03 December 2025 10:56:11 +0000 (0:00:00.068) 0:06:01.624 **** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Wednesday 03 December 2025 10:56:12 +0000 (0:00:00.968) 0:06:02.593 **** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Dump current-podified hash] ********************************* Wednesday 03 December 2025 10:56:13 +0000 (0:00:00.976) 0:06:03.570 **** skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Wednesday 03 December 2025 10:56:13 +0000 (0:00:00.049) 0:06:03.620 **** skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Wednesday 03 December 2025 10:56:13 +0000 (0:00:00.051) 0:06:03.671 **** skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Wednesday 03 December 2025 10:56:13 +0000 (0:00:00.048) 0:06:03.720 **** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Create download directory] ********************************** Wednesday 03 December 2025 10:56:14 +0000 (0:00:00.059) 0:06:03.779 **** skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Wednesday 03 December 2025 10:56:14 +0000 (0:00:00.043) 0:06:03.823 **** skipping: [instance] TASK [Download the RPM] ******************************************************** Wednesday 03 December 2025 10:56:14 +0000 (0:00:00.042) 0:06:03.866 **** skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Wednesday 03 December 2025 10:56:14 +0000 (0:00:00.048) 0:06:03.915 **** skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Wednesday 03 December 2025 10:56:14 +0000 (0:00:00.043) 0:06:03.958 **** skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Wednesday 03 December 2025 10:56:14 +0000 (0:00:00.053) 0:06:04.011 **** skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Wednesday 03 December 2025 10:56:14 +0000 (0:00:00.043) 0:06:04.055 **** skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Wednesday 03 December 2025 10:56:14 +0000 (0:00:00.042) 0:06:04.097 **** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Wednesday 03 December 2025 10:56:14 +0000 (0:00:00.520) 0:06:04.618 **** skipping: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Wednesday 03 December 2025 10:56:14 +0000 (0:00:00.069) 0:06:04.688 **** skipping: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Wednesday 03 December 2025 10:56:15 +0000 (0:00:00.210) 0:06:04.898 **** skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Wednesday 03 December 2025 10:56:15 +0000 (0:00:00.049) 0:06:04.947 **** skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Wednesday 03 December 2025 10:56:15 +0000 (0:00:00.063) 0:06:05.011 **** skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Wednesday 03 December 2025 10:56:15 +0000 (0:00:00.063) 0:06:05.075 **** skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Wednesday 03 December 2025 10:56:15 +0000 (0:00:00.064) 0:06:05.139 **** skipping: [instance] TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** Wednesday 03 December 2025 10:56:15 +0000 (0:00:00.068) 0:06:05.208 **** skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Wednesday 03 December 2025 10:56:15 +0000 (0:00:00.064) 0:06:05.273 **** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Wednesday 03 December 2025 10:56:16 +0000 (0:00:00.634) 0:06:05.907 **** changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [repo_setup : Cleanup existing metadata] ********************************** Wednesday 03 December 2025 10:56:17 +0000 (0:00:01.119) 0:06:07.026 **** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Wednesday 03 December 2025 10:56:18 +0000 (0:00:00.784) 0:06:07.810 **** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Gather variables for each operating system] ******************* Wednesday 03 December 2025 10:56:18 +0000 (0:00:00.601) 0:06:08.412 **** ok: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0] TASK [ci_setup : List packages to install] ************************************* Wednesday 03 December 2025 10:56:18 +0000 (0:00:00.071) 0:06:08.483 **** ok: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Install needed packages] ************************************** Wednesday 03 December 2025 10:56:18 +0000 (0:00:00.054) 0:06:08.538 **** ok: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Gather version of openshift client] *************************** Wednesday 03 December 2025 10:56:52 +0000 (0:00:33.714) 0:06:42.252 **** ok: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Ensure openshift client install path is present] ************** Wednesday 03 December 2025 10:56:53 +0000 (0:00:00.528) 0:06:42.781 **** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Install openshift client] ************************************* Wednesday 03 December 2025 10:56:53 +0000 (0:00:00.542) 0:06:43.323 **** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** Wednesday 03 December 2025 10:56:59 +0000 (0:00:06.157) 0:06:49.481 **** skipping: [instance] TASK [ci_setup : Create completion file] *************************************** Wednesday 03 December 2025 10:56:59 +0000 (0:00:00.055) 0:06:49.536 **** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Source completion from within .bashrc] ************************ Wednesday 03 December 2025 10:57:00 +0000 (0:00:00.708) 0:06:50.246 **** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Check rhsm status] ******************************************** Wednesday 03 December 2025 10:57:01 +0000 (0:00:00.513) 0:06:50.759 **** skipping: [instance] TASK [ci_setup : Gather the repos to be enabled] ******************************* Wednesday 03 December 2025 10:57:01 +0000 (0:00:00.049) 0:06:50.809 **** skipping: [instance] TASK [ci_setup : Enabling the required repositories.] ************************** Wednesday 03 December 2025 10:57:01 +0000 (0:00:00.050) 0:06:50.859 **** skipping: [instance] TASK [ci_setup : Get current /etc/redhat-release] ****************************** Wednesday 03 December 2025 10:57:01 +0000 (0:00:00.048) 0:06:50.908 **** skipping: [instance] TASK [ci_setup : Print current /etc/redhat-release] **************************** Wednesday 03 December 2025 10:57:01 +0000 (0:00:00.046) 0:06:50.954 **** skipping: [instance] TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* Wednesday 03 December 2025 10:57:01 +0000 (0:00:00.046) 0:06:51.001 **** skipping: [instance] TASK [ci_setup : Manage directories] ******************************************* Wednesday 03 December 2025 10:57:01 +0000 (0:00:00.046) 0:06:51.048 **** changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [Prepare install_yamls make targets] ************************************** Wednesday 03 December 2025 10:57:04 +0000 (0:00:02.716) 0:06:53.764 **** TASK [install_yamls : Ensure directories exist] ******************************** Wednesday 03 December 2025 10:57:04 +0000 (0:00:00.165) 0:06:53.929 **** ok: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [Create variables with local repos based on Zuul items] ******************* Wednesday 03 December 2025 10:57:05 +0000 (0:00:01.610) 0:06:55.540 **** TASK [install_yamls : Set fact with local repos based on Zuul items] *********** Wednesday 03 December 2025 10:57:05 +0000 (0:00:00.067) 0:06:55.608 **** skipping: [instance] TASK [install_yamls : Print helpful data for debugging] ************************ Wednesday 03 December 2025 10:57:05 +0000 (0:00:00.050) 0:06:55.658 **** skipping: [instance] TASK [Customize install_yamls devsetup vars if needed] ************************* Wednesday 03 December 2025 10:57:05 +0000 (0:00:00.053) 0:06:55.711 **** TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** Wednesday 03 December 2025 10:57:06 +0000 (0:00:00.066) 0:06:55.778 **** skipping: [instance] TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** Wednesday 03 December 2025 10:57:06 +0000 (0:00:00.044) 0:06:55.823 **** skipping: [instance] TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** Wednesday 03 December 2025 10:57:06 +0000 (0:00:00.042) 0:06:55.865 **** skipping: [instance] TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** Wednesday 03 December 2025 10:57:06 +0000 (0:00:00.042) 0:06:55.908 **** skipping: [instance] TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** Wednesday 03 December 2025 10:57:06 +0000 (0:00:00.048) 0:06:55.957 **** ok: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0] TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** Wednesday 03 December 2025 10:57:06 +0000 (0:00:00.092) 0:06:56.049 **** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Get environment structure] ******************************* Wednesday 03 December 2025 10:57:06 +0000 (0:00:00.079) 0:06:56.129 **** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Ensure Output directory exists] ************************** Wednesday 03 December 2025 10:57:07 +0000 (0:00:01.143) 0:06:57.272 **** skipping: [instance] TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** Wednesday 03 December 2025 10:57:07 +0000 (0:00:00.046) 0:06:57.319 **** skipping: [instance] TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** Wednesday 03 December 2025 10:57:07 +0000 (0:00:00.062) 0:06:57.381 **** skipping: [instance] TASK [install_yamls : Set install_yamls default values] ************************ Wednesday 03 December 2025 10:57:07 +0000 (0:00:00.041) 0:06:57.422 **** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Show the env structure] ********************************** Wednesday 03 December 2025 10:57:07 +0000 (0:00:00.059) 0:06:57.482 **** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Show the env structure defaults] ************************* Wednesday 03 December 2025 10:57:07 +0000 (0:00:00.133) 0:06:57.616 **** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Generate make targets] *********************************** Wednesday 03 December 2025 10:57:07 +0000 (0:00:00.063) 0:06:57.680 **** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Debug generate_make module] ****************************** Wednesday 03 December 2025 10:57:08 +0000 (0:00:00.646) 0:06:58.326 **** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Create the install_yamls parameters file] **************** Wednesday 03 December 2025 10:57:08 +0000 (0:00:00.061) 0:06:58.388 **** changed: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** Wednesday 03 December 2025 10:57:09 +0000 (0:00:00.983) 0:06:59.371 **** skipping: [instance] TASK [discover_latest_image : Get latest image] ******************************** Wednesday 03 December 2025 10:57:09 +0000 (0:00:00.061) 0:06:59.432 **** changed: [instance -> controller-0(controller-0.instance)] TASK [discover_latest_image : Export facts accordingly] ************************ Wednesday 03 December 2025 10:57:10 +0000 (0:00:00.796) 0:07:00.229 **** ok: [instance -> controller-0(controller-0.instance)] TASK [cifmw_setup : Create artifacts with custom params] *********************** Wednesday 03 December 2025 10:57:10 +0000 (0:00:00.066) 0:07:00.296 **** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* Wednesday 03 December 2025 10:57:11 +0000 (0:00:01.070) 0:07:01.366 **** ok: [instance -> controller-0(controller-0.instance)] TASK [Configure CRC network if needed] ***************************************** Wednesday 03 December 2025 10:57:12 +0000 (0:00:00.555) 0:07:01.921 **** TASK [openshift_setup : Gather network.operator info] ************************** Wednesday 03 December 2025 10:57:12 +0000 (0:00:00.166) 0:07:02.087 **** ok: [instance -> controller-0(controller-0.instance)] TASK [openshift_setup : Patch network operator] ******************************** Wednesday 03 December 2025 10:57:13 +0000 (0:00:01.256) 0:07:03.344 **** changed: [instance -> controller-0(controller-0.instance)] TASK [Ensure OCP cluster is stable] ******************************************** Wednesday 03 December 2025 10:57:14 +0000 (0:00:01.235) 0:07:04.579 **** skipping: [instance] TASK [reproducer : Emulate CI job] ********************************************* Wednesday 03 December 2025 10:57:14 +0000 (0:00:00.039) 0:07:04.619 **** skipping: [instance] TASK [reproducer : Currently reproducer vars] ********************************** Wednesday 03 December 2025 10:57:14 +0000 (0:00:00.050) 0:07:04.669 **** fatal: [instance -> controller-0]: FAILED! => msg: |- The task includes an option with an undefined variable. The error was: 'cifmw_deploy_reproducer_env' is undefined. 'cifmw_deploy_reproducer_env' is undefined The error appears to be in '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/main.yml': line 366, column 7, but may be elsewhere in the file depending on the exact syntax problem. The offending line appears to be: - name: Currently reproducer vars ^ here TASK [Create dnsmasq dir] ****************************************************** Wednesday 03 December 2025 10:57:14 +0000 (0:00:00.058) 0:07:04.727 **** changed: [instance] TASK [Get journalctl in a file] ************************************************ Wednesday 03 December 2025 10:57:15 +0000 (0:00:00.242) 0:07:04.970 **** changed: [instance] TASK [Dump journalctl output] ************************************************** Wednesday 03 December 2025 10:57:15 +0000 (0:00:00.269) 0:07:05.240 **** changed: [instance] TASK [Copy all dnsmasq config] ************************************************* Wednesday 03 December 2025 10:57:15 +0000 (0:00:00.456) 0:07:05.696 **** changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) TASK [Create log directory] **************************************************** Wednesday 03 December 2025 10:57:16 +0000 (0:00:00.563) 0:07:06.260 **** changed: [instance] TASK [Sync logs from controller-0] ********************************************* Wednesday 03 December 2025 10:57:16 +0000 (0:00:00.237) 0:07:06.497 **** changed: [instance] PLAY RECAP ********************************************************************* instance : ok=542 changed=210 unreachable=0 failed=1 skipped=224 rescued=0 ignored=0 Wednesday 03 December 2025 10:57:17 +0000 (0:00:00.946) 0:07:07.444 **** =============================================================================== reproducer : Check package install status ------------------------------ 56.39s ci_setup : Install needed packages ------------------------------------- 33.71s libvirt_manager : Download base image ---------------------------------- 20.37s libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.84s reproducer : Install collections on controller-0 ----------------------- 19.35s sushy_emulator : Pull Sushy Emulator container image ------------------- 11.13s libvirt_manager : Install packages required for using KVM -------------- 10.83s repo_setup : Initialize python venv and install requirements ------------ 8.03s ci_setup : Install openshift client ------------------------------------- 6.16s reproducer : Ensure we have all dependencies installed ------------------ 5.97s sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.28s ci_nmstate : Install required packages on localhost --------------------- 5.13s dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.54s networking_mapper : Gather the facts ------------------------------------ 3.26s sushy_emulator : Install required packages ------------------------------ 3.14s dnsmasq : Add/Remove address -------------------------------------------- 3.00s ci_setup : Manage directories ------------------------------------------- 2.72s reproducer : Clone repository if needed: architecture ------------------- 2.24s reproducer : Sync local repositories to other hosts if present ---------- 2.11s libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s