PLAY [Prepare] ***************************************************************** TASK [Gathering Facts] ********************************************************* Thursday 09 October 2025 21:02:29 +0000 (0:00:00.018) 0:00:00.018 ****** ok: [instance] TASK [Create custom basedir] *************************************************** Thursday 09 October 2025 21:02:30 +0000 (0:00:00.834) 0:00:00.853 ****** changed: [instance] TASK [test_deps : Gather facts if they don't exist] **************************** Thursday 09 October 2025 21:02:30 +0000 (0:00:00.334) 0:00:01.188 ****** skipping: [instance] TASK [test_deps : Gather variables for each operating system] ****************** Thursday 09 October 2025 21:02:30 +0000 (0:00:00.025) 0:00:01.213 ****** ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) TASK [test_deps : Detect mirrors file] ***************************************** Thursday 09 October 2025 21:02:31 +0000 (0:00:00.046) 0:00:01.260 ****** ok: [instance] TASK [test_deps : Disable ubi host subscription-manager integration] *********** Thursday 09 October 2025 21:02:31 +0000 (0:00:00.276) 0:00:01.536 ****** ok: [instance] TASK [test_deps : Disable ubi 9 repos] ***************************************** Thursday 09 October 2025 21:02:31 +0000 (0:00:00.208) 0:00:01.745 ****** ok: [instance] => (item=ubi-9-appstream) ok: [instance] => (item=ubi-9-baseos) ok: [instance] => (item=ubi-9-codeready-builder) TASK [Deploy repo-setup] ******************************************************* Thursday 09 October 2025 21:02:32 +0000 (0:00:00.675) 0:00:02.420 ****** TASK [repo_setup : Ensure directories are present] ***************************** Thursday 09 October 2025 21:02:32 +0000 (0:00:00.061) 0:00:02.482 ****** changed: [instance] => (item=tmp) changed: [instance] => (item=artifacts/repositories) changed: [instance] => (item=venv/repo_setup) TASK [repo_setup : Make sure git-core package is installed] ******************** Thursday 09 October 2025 21:02:32 +0000 (0:00:00.521) 0:00:03.003 ****** ok: [instance] TASK [repo_setup : Get repo-setup repository] ********************************** Thursday 09 October 2025 21:02:33 +0000 (0:00:00.775) 0:00:03.778 ****** changed: [instance] TASK [repo_setup : Initialize python venv and install requirements] ************ Thursday 09 October 2025 21:02:34 +0000 (0:00:01.172) 0:00:04.951 ****** changed: [instance] TASK [repo_setup : Install repo-setup package] ********************************* Thursday 09 October 2025 21:02:42 +0000 (0:00:07.606) 0:00:12.557 ****** changed: [instance] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Thursday 09 October 2025 21:02:43 +0000 (0:00:00.699) 0:00:13.256 ****** skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Thursday 09 October 2025 21:02:43 +0000 (0:00:00.023) 0:00:13.280 ****** changed: [instance] TASK [repo_setup : Get component repo] ***************************************** Thursday 09 October 2025 21:02:43 +0000 (0:00:00.843) 0:00:14.124 ****** skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Thursday 09 October 2025 21:02:43 +0000 (0:00:00.034) 0:00:14.159 ****** skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Thursday 09 October 2025 21:02:43 +0000 (0:00:00.034) 0:00:14.193 ****** skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Thursday 09 October 2025 21:02:43 +0000 (0:00:00.036) 0:00:14.229 ****** changed: [instance] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Thursday 09 October 2025 21:02:44 +0000 (0:00:00.530) 0:00:14.760 ****** changed: [instance] TASK [repo_setup : Dump current-podified hash] ********************************* Thursday 09 October 2025 21:02:44 +0000 (0:00:00.422) 0:00:15.182 ****** skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Thursday 09 October 2025 21:02:44 +0000 (0:00:00.029) 0:00:15.211 ****** skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Thursday 09 October 2025 21:02:44 +0000 (0:00:00.028) 0:00:15.240 ****** skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Thursday 09 October 2025 21:02:45 +0000 (0:00:00.028) 0:00:15.268 ****** ok: [instance] TASK [repo_setup : Create download directory] ********************************** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.035) 0:00:15.304 ****** skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.330 ****** skipping: [instance] TASK [Download the RPM] ******************************************************** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.357 ****** skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.027) 0:00:15.384 ****** skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.411 ****** skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.027) 0:00:15.439 ****** skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.029) 0:00:15.468 ****** skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.495 ****** ok: [instance] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.188) 0:00:15.683 ****** changed: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.207) 0:00:15.890 ****** changed: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Thursday 09 October 2025 21:02:45 +0000 (0:00:00.219) 0:00:16.110 ****** skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.021) 0:00:16.131 ****** skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Thursday 09 October 2025 21:02:45 +0000 (0:00:00.021) 0:00:16.153 ****** skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.020) 0:00:16.173 ****** skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.020) 0:00:16.193 ****** skipping: [instance] TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.022) 0:00:16.215 ****** skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Thursday 09 October 2025 21:02:45 +0000 (0:00:00.021) 0:00:16.237 ****** skipping: [instance] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Thursday 09 October 2025 21:02:46 +0000 (0:00:00.016) 0:00:16.254 ****** skipping: [instance] TASK [repo_setup : Cleanup existing metadata] ********************************** Thursday 09 October 2025 21:02:46 +0000 (0:00:00.028) 0:00:16.283 ****** skipping: [instance] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Thursday 09 October 2025 21:02:46 +0000 (0:00:00.016) 0:00:16.299 ****** skipping: [instance] TASK [test_deps : Look for redhat-release rpm] ********************************* Thursday 09 October 2025 21:02:46 +0000 (0:00:00.020) 0:00:16.320 ****** skipping: [instance] TASK [test_deps : Remove redhat-release] *************************************** Thursday 09 October 2025 21:02:46 +0000 (0:00:00.027) 0:00:16.347 ****** skipping: [instance] TASK [test_deps : Install centos-stream-release] ******************************* Thursday 09 October 2025 21:02:46 +0000 (0:00:00.027) 0:00:16.375 ****** skipping: [instance] TASK [test_deps : Install additional packages] ********************************* Thursday 09 October 2025 21:02:46 +0000 (0:00:00.026) 0:00:16.402 ****** skipping: [instance] TASK [test_deps : Install selinux python libs] ********************************* Thursday 09 October 2025 21:02:46 +0000 (0:00:00.026) 0:00:16.429 ****** ok: [instance] TASK [test_deps : Install python yaml libs] ************************************ Thursday 09 October 2025 21:03:31 +0000 (0:00:44.984) 0:01:01.413 ****** ok: [instance] TASK [test_deps : Install extra packages] ************************************** Thursday 09 October 2025 21:03:32 +0000 (0:00:01.189) 0:01:02.603 ****** skipping: [instance] TASK [ci_setup : Gather variables for each operating system] ******************* Thursday 09 October 2025 21:03:32 +0000 (0:00:00.041) 0:01:02.644 ****** ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) TASK [ci_setup : List packages to install] ************************************* Thursday 09 October 2025 21:03:32 +0000 (0:00:00.048) 0:01:02.692 ****** ok: [instance] => cifmw_ci_setup_packages: - bash-completion - ca-certificates - git-core - make - tar - tmux - python3-pip TASK [ci_setup : Install needed packages] ************************************** Thursday 09 October 2025 21:03:32 +0000 (0:00:00.021) 0:01:02.714 ****** changed: [instance] TASK [ci_setup : Gather version of openshift client] *************************** Thursday 09 October 2025 21:03:38 +0000 (0:00:05.635) 0:01:08.350 ****** ok: [instance] TASK [ci_setup : Ensure openshift client install path is present] ************** Thursday 09 October 2025 21:03:38 +0000 (0:00:00.616) 0:01:08.966 ****** changed: [instance] TASK [ci_setup : Install openshift client] ************************************* Thursday 09 October 2025 21:03:38 +0000 (0:00:00.228) 0:01:09.195 ****** changed: [instance] TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** Thursday 09 October 2025 21:03:44 +0000 (0:00:06.030) 0:01:15.225 ****** ok: [instance] TASK [ci_setup : Create completion file] *************************************** Thursday 09 October 2025 21:03:45 +0000 (0:00:00.039) 0:01:15.265 ****** changed: [instance] TASK [ci_setup : Source completion from within .bashrc] ************************ Thursday 09 October 2025 21:03:45 +0000 (0:00:00.269) 0:01:15.534 ****** changed: [instance] TASK [ci_setup : Check rhsm status] ******************************************** Thursday 09 October 2025 21:03:45 +0000 (0:00:00.278) 0:01:15.813 ****** skipping: [instance] TASK [ci_setup : Gather the repos to be enabled] ******************************* Thursday 09 October 2025 21:03:45 +0000 (0:00:00.020) 0:01:15.833 ****** skipping: [instance] TASK [ci_setup : Enabling the required repositories.] ************************** Thursday 09 October 2025 21:03:45 +0000 (0:00:00.018) 0:01:15.851 ****** skipping: [instance] TASK [ci_setup : Get current /etc/redhat-release] ****************************** Thursday 09 October 2025 21:03:45 +0000 (0:00:00.018) 0:01:15.870 ****** skipping: [instance] TASK [ci_setup : Print current /etc/redhat-release] **************************** Thursday 09 October 2025 21:03:45 +0000 (0:00:00.017) 0:01:15.887 ****** skipping: [instance] TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* Thursday 09 October 2025 21:03:45 +0000 (0:00:00.036) 0:01:15.924 ****** skipping: [instance] TASK [ci_setup : Manage directories] ******************************************* Thursday 09 October 2025 21:03:45 +0000 (0:00:00.023) 0:01:15.947 ****** changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) changed: [instance] => (item=/opt/basedir/logs) ok: [instance] => (item=/opt/basedir/tmp) changed: [instance] => (item=/opt/basedir/volumes) changed: [instance] => (item=/opt/basedir/artifacts/parameters) TASK [Create secret file] ****************************************************** Thursday 09 October 2025 21:03:46 +0000 (0:00:01.006) 0:01:16.954 ****** changed: [instance] PLAY RECAP ********************************************************************* instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 Thursday 09 October 2025 21:03:47 +0000 (0:00:00.336) 0:01:17.290 ****** =============================================================================== test_deps : Install selinux python libs -------------------------------- 44.98s repo_setup : Initialize python venv and install requirements ------------ 7.61s ci_setup : Install openshift client ------------------------------------- 6.03s ci_setup : Install needed packages -------------------------------------- 5.64s test_deps : Install python yaml libs ------------------------------------ 1.19s repo_setup : Get repo-setup repository ---------------------------------- 1.17s ci_setup : Manage directories ------------------------------------------- 1.01s repo_setup : Run repo-setup --------------------------------------------- 0.84s Gathering Facts --------------------------------------------------------- 0.83s repo_setup : Make sure git-core package is installed -------------------- 0.78s repo_setup : Install repo-setup package --------------------------------- 0.70s test_deps : Disable ubi 9 repos ----------------------------------------- 0.68s ci_setup : Gather version of openshift client --------------------------- 0.62s repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s repo_setup : Ensure directories are present ----------------------------- 0.52s repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.42s Create secret file ------------------------------------------------------ 0.34s Create custom basedir --------------------------------------------------- 0.33s ci_setup : Source completion from within .bashrc ------------------------ 0.28s test_deps : Detect mirrors file ----------------------------------------- 0.28s PLAY [Converge] **************************************************************** TASK [Gathering Facts] ********************************************************* Thursday 09 October 2025 21:03:47 +0000 (0:00:00.025) 0:00:00.025 ****** ok: [instance] TASK [Load networking definition from scenario file] *************************** Thursday 09 October 2025 21:03:48 +0000 (0:00:00.818) 0:00:00.844 ****** ok: [instance] TASK [discover_latest_image : Get latest image] ******************************** Thursday 09 October 2025 21:03:48 +0000 (0:00:00.023) 0:00:00.868 ****** changed: [instance] TASK [discover_latest_image : Export facts accordingly] ************************ Thursday 09 October 2025 21:03:50 +0000 (0:00:01.882) 0:00:02.750 ****** ok: [instance] TASK [reproducer : Load CI job environment] ************************************ Thursday 09 October 2025 21:03:50 +0000 (0:00:00.026) 0:00:02.777 ****** skipping: [instance] TASK [reproducer : Discover and expose CI Framework path on remote node] ******* Thursday 09 October 2025 21:03:50 +0000 (0:00:00.020) 0:00:02.797 ****** ok: [instance] TASK [Build final libvirt layout] ********************************************** Thursday 09 October 2025 21:03:50 +0000 (0:00:00.077) 0:00:02.874 ****** TASK [libvirt_manager : Chose right parameter for layout definition] *********** Thursday 09 October 2025 21:03:50 +0000 (0:00:00.049) 0:00:02.924 ****** ok: [instance] TASK [libvirt_manager : Patch the layout if needed] **************************** Thursday 09 October 2025 21:03:50 +0000 (0:00:00.081) 0:00:03.005 ****** skipping: [instance] TASK [reproducer : Assert no conflicting parameters were passed] *************** Thursday 09 October 2025 21:03:50 +0000 (0:00:00.061) 0:00:03.066 ****** ok: [instance] TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** Thursday 09 October 2025 21:03:50 +0000 (0:00:00.026) 0:00:03.093 ****** ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Set _use_crc based on actual layout] ************************ Thursday 09 October 2025 21:03:50 +0000 (0:00:00.024) 0:00:03.118 ****** ok: [instance] TASK [reproducer : Ensure directories are present] ***************************** Thursday 09 October 2025 21:03:50 +0000 (0:00:00.044) 0:00:03.162 ****** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [Bootstrap libvirt if needed] ********************************************* Thursday 09 October 2025 21:03:51 +0000 (0:00:00.458) 0:00:03.621 ****** TASK [libvirt_manager : Ensure output directory exists] ************************ Thursday 09 October 2025 21:03:51 +0000 (0:00:00.076) 0:00:03.697 ****** ok: [instance] TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* Thursday 09 October 2025 21:03:51 +0000 (0:00:00.191) 0:00:03.889 ****** changed: [instance] TASK [libvirt_manager : Check if KVM is enabled] ******************************* Thursday 09 October 2025 21:03:51 +0000 (0:00:00.256) 0:00:04.145 ****** ok: [instance] TASK [libvirt_manager : Fail if KVM not enabled] ******************************* Thursday 09 October 2025 21:03:52 +0000 (0:00:00.285) 0:00:04.431 ****** skipping: [instance] TASK [libvirt_manager : Check if VMX virtualization] *************************** Thursday 09 October 2025 21:03:52 +0000 (0:00:00.031) 0:00:04.462 ****** skipping: [instance] TASK [libvirt_manager : Check if SVM virtualization] *************************** Thursday 09 October 2025 21:03:52 +0000 (0:00:00.018) 0:00:04.480 ****** ok: [instance] TASK [libvirt_manager : Enable VMX virtualization] ***************************** Thursday 09 October 2025 21:03:52 +0000 (0:00:00.021) 0:00:04.501 ****** skipping: [instance] TASK [libvirt_manager : Install packages required for using KVM] *************** Thursday 09 October 2025 21:03:52 +0000 (0:00:00.029) 0:00:04.531 ****** changed: [instance] TASK [libvirt_manager : Create rules.d polkit folder] ************************** Thursday 09 October 2025 21:04:03 +0000 (0:00:11.644) 0:00:16.175 ****** changed: [instance] TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* Thursday 09 October 2025 21:04:04 +0000 (0:00:00.224) 0:00:16.399 ****** changed: [instance] TASK [libvirt_manager : Restart service polkit service] ************************ Thursday 09 October 2025 21:04:04 +0000 (0:00:00.526) 0:00:16.926 ****** changed: [instance] TASK [libvirt_manager : Remove directory for service override] ***************** Thursday 09 October 2025 21:04:05 +0000 (0:00:00.605) 0:00:17.531 ****** ok: [instance] TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** Thursday 09 October 2025 21:04:05 +0000 (0:00:00.208) 0:00:17.740 ****** ok: [instance] TASK [libvirt_manager : Ensure firewalld service is up] ************************ Thursday 09 October 2025 21:04:06 +0000 (0:00:00.697) 0:00:18.437 ****** changed: [instance] TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** Thursday 09 October 2025 21:04:07 +0000 (0:00:00.979) 0:00:19.417 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* Thursday 09 October 2025 21:04:07 +0000 (0:00:00.085) 0:00:19.502 ****** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** Thursday 09 October 2025 21:04:07 +0000 (0:00:00.361) 0:00:19.864 ****** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** Thursday 09 October 2025 21:04:07 +0000 (0:00:00.357) 0:00:20.221 ****** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** Thursday 09 October 2025 21:04:08 +0000 (0:00:00.353) 0:00:20.574 ****** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** Thursday 09 October 2025 21:04:08 +0000 (0:00:00.339) 0:00:20.914 ****** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* Thursday 09 October 2025 21:04:08 +0000 (0:00:00.334) 0:00:21.248 ****** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** Thursday 09 October 2025 21:04:09 +0000 (0:00:00.345) 0:00:21.594 ****** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* Thursday 09 October 2025 21:04:09 +0000 (0:00:00.349) 0:00:21.943 ****** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** Thursday 09 October 2025 21:04:09 +0000 (0:00:00.338) 0:00:22.281 ****** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** Thursday 09 October 2025 21:04:10 +0000 (0:00:00.330) 0:00:22.612 ****** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* Thursday 09 October 2025 21:04:11 +0000 (0:00:01.338) 0:00:23.950 ****** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** Thursday 09 October 2025 21:04:12 +0000 (0:00:00.399) 0:00:24.350 ****** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** Thursday 09 October 2025 21:04:12 +0000 (0:00:00.349) 0:00:24.699 ****** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** Thursday 09 October 2025 21:04:12 +0000 (0:00:00.342) 0:00:25.041 ****** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** Thursday 09 October 2025 21:04:13 +0000 (0:00:00.344) 0:00:25.386 ****** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* Thursday 09 October 2025 21:04:13 +0000 (0:00:00.366) 0:00:25.752 ****** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** Thursday 09 October 2025 21:04:13 +0000 (0:00:00.340) 0:00:26.093 ****** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ Thursday 09 October 2025 21:04:15 +0000 (0:00:01.344) 0:00:27.438 ****** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** Thursday 09 October 2025 21:04:15 +0000 (0:00:00.337) 0:00:27.776 ****** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* Thursday 09 October 2025 21:04:15 +0000 (0:00:00.334) 0:00:28.110 ****** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** Thursday 09 October 2025 21:04:16 +0000 (0:00:00.336) 0:00:28.446 ****** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** Thursday 09 October 2025 21:04:16 +0000 (0:00:00.332) 0:00:28.778 ****** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* Thursday 09 October 2025 21:04:16 +0000 (0:00:00.333) 0:00:29.112 ****** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* Thursday 09 October 2025 21:04:17 +0000 (0:00:00.337) 0:00:29.449 ****** ok: [instance] TASK [libvirt_manager : Manage service for older releases] ********************* Thursday 09 October 2025 21:04:17 +0000 (0:00:00.337) 0:00:29.787 ****** skipping: [instance] TASK [libvirt_manager : Get libvirt group users] ******************************* Thursday 09 October 2025 21:04:17 +0000 (0:00:00.028) 0:00:29.815 ****** ok: [instance] TASK [libvirt_manager : Add user if not exists in libvirt group] *************** Thursday 09 October 2025 21:04:17 +0000 (0:00:00.306) 0:00:30.122 ****** ok: [instance] TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** Thursday 09 October 2025 21:04:18 +0000 (0:00:00.386) 0:00:30.508 ****** changed: [instance] TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* Thursday 09 October 2025 21:04:18 +0000 (0:00:00.315) 0:00:30.824 ****** [WARNING]: Reset is not implemented for this connection changed: [instance] TASK [libvirt_manager : Ensure we reload user env] ***************************** Thursday 09 October 2025 21:04:18 +0000 (0:00:00.291) 0:00:31.115 ****** TASK [reproducer : Deploy networks in libvirt] ********************************* Thursday 09 October 2025 21:04:18 +0000 (0:00:00.016) 0:00:31.131 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance TASK [reproducer : Ensure networks are consistent] ***************************** Thursday 09 October 2025 21:04:18 +0000 (0:00:00.075) 0:00:31.207 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Thursday 09 October 2025 21:04:18 +0000 (0:00:00.042) 0:00:31.249 ****** ok: [instance] => (item=compute) ok: [instance] => (item=controller) ok: [instance] => (item=crc) TASK [reproducer : Ensure all standard attached networks are defined] ********** Thursday 09 October 2025 21:04:18 +0000 (0:00:00.048) 0:00:31.297 ****** ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Thursday 09 October 2025 21:04:18 +0000 (0:00:00.041) 0:00:31.339 ****** ok: [instance] => changed=false msg: All assertions passed TASK [Ensure we get latest OCP config] ***************************************** Thursday 09 October 2025 21:04:19 +0000 (0:00:00.047) 0:00:31.386 ****** TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** Thursday 09 October 2025 21:04:19 +0000 (0:00:00.042) 0:00:31.429 ****** ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) ok: [instance] => (item={}) TASK [devscripts : Replace OCP version if "stable-" alias used] **************** Thursday 09 October 2025 21:04:19 +0000 (0:00:00.074) 0:00:31.503 ****** skipping: [instance] TASK [devscripts : Ensure output directory exists] ***************************** Thursday 09 October 2025 21:04:19 +0000 (0:00:00.018) 0:00:31.522 ****** ok: [instance] TASK [devscripts : Output built config for easier debugging] ******************* Thursday 09 October 2025 21:04:19 +0000 (0:00:00.236) 0:00:31.758 ****** changed: [instance] TASK [ci_network : Remove the local dns configuration] ************************* Thursday 09 October 2025 21:04:19 +0000 (0:00:00.376) 0:00:32.135 ****** ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) TASK [ci_network : Reload the NetworkManager to pick the changes] ************** Thursday 09 October 2025 21:04:20 +0000 (0:00:00.802) 0:00:32.938 ****** skipping: [instance] TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* Thursday 09 October 2025 21:04:20 +0000 (0:00:00.034) 0:00:32.972 ****** changed: [instance] TASK [reproducer : Flush handlers for NetworkManager restart] ****************** Thursday 09 October 2025 21:04:21 +0000 (0:00:00.384) 0:00:33.357 ****** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Thursday 09 October 2025 21:04:21 +0000 (0:00:00.008) 0:00:33.365 ****** changed: [instance] TASK [Ensure no default networks exists] *************************************** Thursday 09 October 2025 21:04:21 +0000 (0:00:00.441) 0:00:33.806 ****** TASK [libvirt_manager : Deactivate crc] **************************************** Thursday 09 October 2025 21:04:21 +0000 (0:00:00.078) 0:00:33.885 ****** ok: [instance] TASK [libvirt_manager : Removing crc] ****************************************** Thursday 09 October 2025 21:04:22 +0000 (0:00:01.247) 0:00:35.132 ****** ok: [instance] TASK [libvirt_manager : Deactivate default] ************************************ Thursday 09 October 2025 21:04:23 +0000 (0:00:00.266) 0:00:35.398 ****** ok: [instance] TASK [libvirt_manager : Removing default] ************************************** Thursday 09 October 2025 21:04:23 +0000 (0:00:00.534) 0:00:35.933 ****** ok: [instance] TASK [reproducer : Ensure firewalld is installed] ****************************** Thursday 09 October 2025 21:04:23 +0000 (0:00:00.256) 0:00:36.189 ****** ok: [instance] TASK [reproducer : Ensure firewalld service is enabled and started] ************ Thursday 09 October 2025 21:04:25 +0000 (0:00:01.221) 0:00:37.411 ****** ok: [instance] TASK [reproducer : Ensure br_netfilter module is loaded] *********************** Thursday 09 October 2025 21:04:25 +0000 (0:00:00.335) 0:00:37.746 ****** changed: [instance] TASK [reproducer : Ensure IP forwarding is enabled] **************************** Thursday 09 October 2025 21:04:25 +0000 (0:00:00.347) 0:00:38.093 ****** changed: [instance] TASK [reproducer : Ensure the required parameters are loaded] ****************** Thursday 09 October 2025 21:04:26 +0000 (0:00:00.345) 0:00:38.439 ****** changed: [instance] => (item=arptables) changed: [instance] => (item=iptables) changed: [instance] => (item=ip6tables) TASK [reproducer : Ensure firewall service is enabled and started] ************* Thursday 09 October 2025 21:04:28 +0000 (0:00:02.628) 0:00:41.068 ****** ok: [instance] TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* Thursday 09 October 2025 21:04:29 +0000 (0:00:00.336) 0:00:41.404 ****** ok: [instance] TASK [Ensure the required network configurations are applied] ****************** Thursday 09 October 2025 21:04:29 +0000 (0:00:00.094) 0:00:41.498 ****** TASK [networking_mapper : Check for Networking Environment Definition file existence] *** Thursday 09 October 2025 21:04:29 +0000 (0:00:00.047) 0:00:41.545 ****** skipping: [instance] TASK [networking_mapper : Check for Networking Definition file existance] ****** Thursday 09 October 2025 21:04:29 +0000 (0:00:00.025) 0:00:41.571 ****** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Thursday 09 October 2025 21:04:29 +0000 (0:00:00.024) 0:00:41.596 ****** skipping: [instance] TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** Thursday 09 October 2025 21:04:29 +0000 (0:00:00.023) 0:00:41.620 ****** skipping: [instance] TASK [ci_nmstate : Initialize NMstates for each instance] ********************** Thursday 09 October 2025 21:04:29 +0000 (0:00:00.030) 0:00:41.650 ****** ok: [instance] TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** Thursday 09 October 2025 21:04:29 +0000 (0:00:00.039) 0:00:41.689 ****** skipping: [instance] TASK [ci_nmstate : Get k8s nodes] ********************************************** Thursday 09 October 2025 21:04:29 +0000 (0:00:00.035) 0:00:41.725 ****** skipping: [instance] TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** Thursday 09 October 2025 21:04:29 +0000 (0:00:00.026) 0:00:41.751 ****** ok: [instance] TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* Thursday 09 October 2025 21:04:29 +0000 (0:00:00.065) 0:00:41.816 ****** skipping: [instance] TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* Thursday 09 October 2025 21:04:29 +0000 (0:00:00.028) 0:00:41.845 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) TASK [ci_nmstate : Ensure we have needed facts] ******************************** Thursday 09 October 2025 21:04:29 +0000 (0:00:00.052) 0:00:41.898 ****** ok: [instance -> localhost] TASK [ci_nmstate : Install required packages on localhost] ********************* Thursday 09 October 2025 21:04:29 +0000 (0:00:00.348) 0:00:42.246 ****** changed: [instance -> localhost] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Thursday 09 October 2025 21:04:35 +0000 (0:00:05.146) 0:00:47.393 ****** changed: [instance] TASK [ci_nmstate : Save nmstate state for localhost] *************************** Thursday 09 October 2025 21:04:35 +0000 (0:00:00.234) 0:00:47.627 ****** changed: [instance] TASK [ci_nmstate : Apply the desidered state on localhost] ********************* Thursday 09 October 2025 21:04:35 +0000 (0:00:00.358) 0:00:47.986 ****** changed: [instance -> localhost] TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** Thursday 09 October 2025 21:04:37 +0000 (0:00:01.627) 0:00:49.613 ****** changed: [instance] TASK [reproducer : Select right domain] **************************************** Thursday 09 October 2025 21:04:37 +0000 (0:00:00.412) 0:00:50.026 ****** ok: [instance] TASK [Create the virtual networks] ********************************************* Thursday 09 October 2025 21:04:37 +0000 (0:00:00.037) 0:00:50.063 ****** TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** Thursday 09 October 2025 21:04:37 +0000 (0:00:00.118) 0:00:50.182 ****** ok: [instance] TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* Thursday 09 October 2025 21:04:37 +0000 (0:00:00.020) 0:00:50.203 ****** ok: [instance] TASK [libvirt_manager : Load file if exists] *********************************** Thursday 09 October 2025 21:04:38 +0000 (0:00:00.197) 0:00:50.401 ****** skipping: [instance] TASK [libvirt_manager : Update fact with existing content] ********************* Thursday 09 October 2025 21:04:38 +0000 (0:00:00.032) 0:00:50.433 ****** skipping: [instance] TASK [libvirt_manager : Generate VM list] ************************************** Thursday 09 October 2025 21:04:38 +0000 (0:00:00.032) 0:00:50.466 ****** ok: [instance] TASK [libvirt_manager : Generate/update mapping all nodes] ********************* Thursday 09 October 2025 21:04:38 +0000 (0:00:00.061) 0:00:50.528 ****** ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Append baremetal nodes if needed] ********************** Thursday 09 October 2025 21:04:38 +0000 (0:00:00.126) 0:00:50.654 ****** skipping: [instance] TASK [libvirt_manager : Dump MAC mapping] ************************************** Thursday 09 October 2025 21:04:38 +0000 (0:00:00.036) 0:00:50.691 ****** changed: [instance] TASK [libvirt_manager : Inject all VMs in the inventory] *********************** Thursday 09 October 2025 21:04:38 +0000 (0:00:00.365) 0:00:51.056 ****** changed: [instance] => (item=Adding compute-0 to computes) changed: [instance] => (item=Adding controller-0 to controllers) changed: [instance] => (item=Adding crc-0 to ocps) TASK [networking_mapper : Check for Networking Definition file existence] ****** Thursday 09 October 2025 21:04:38 +0000 (0:00:00.119) 0:00:51.176 ****** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Thursday 09 October 2025 21:04:38 +0000 (0:00:00.023) 0:00:51.200 ****** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Thursday 09 October 2025 21:04:38 +0000 (0:00:00.024) 0:00:51.225 ****** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Thursday 09 October 2025 21:04:38 +0000 (0:00:00.025) 0:00:51.250 ****** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Thursday 09 October 2025 21:04:38 +0000 (0:00:00.025) 0:00:51.276 ****** ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Thursday 09 October 2025 21:04:38 +0000 (0:00:00.019) 0:00:51.296 ****** ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Thursday 09 October 2025 21:04:39 +0000 (0:00:00.077) 0:00:51.374 ****** skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Thursday 09 October 2025 21:04:39 +0000 (0:00:00.028) 0:00:51.403 ****** changed: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Thursday 09 October 2025 21:04:39 +0000 (0:00:00.209) 0:00:51.613 ****** changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Thursday 09 October 2025 21:04:39 +0000 (0:00:00.419) 0:00:52.032 ****** ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Thursday 09 October 2025 21:04:39 +0000 (0:00:00.066) 0:00:52.098 ****** ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Thursday 09 October 2025 21:04:39 +0000 (0:00:00.036) 0:00:52.134 ****** changed: [instance] TASK [libvirt_manager : Manage networks if needed] ***************************** Thursday 09 October 2025 21:04:40 +0000 (0:00:00.394) 0:00:52.529 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** Thursday 09 October 2025 21:04:40 +0000 (0:00:00.083) 0:00:52.612 ****** ok: [instance] => (item=public) ok: [instance] => (item=osp_trunk) TASK [libvirt_manager : Ensure networks are defined] *************************** Thursday 09 October 2025 21:04:40 +0000 (0:00:00.077) 0:00:52.690 ****** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are created/started] ******************* Thursday 09 October 2025 21:04:40 +0000 (0:00:00.475) 0:00:53.165 ****** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are active] **************************** Thursday 09 October 2025 21:04:41 +0000 (0:00:00.653) 0:00:53.819 ****** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** Thursday 09 October 2025 21:04:41 +0000 (0:00:00.465) 0:00:54.284 ****** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** Thursday 09 October 2025 21:04:42 +0000 (0:00:00.467) 0:00:54.751 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance TASK [libvirt_manager : Fetch present bridge interfaces] *********************** Thursday 09 October 2025 21:04:42 +0000 (0:00:00.070) 0:00:54.822 ****** ok: [instance] TASK [libvirt_manager : Fetch bridges ports link info] ************************* Thursday 09 October 2025 21:04:42 +0000 (0:00:00.210) 0:00:55.032 ****** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [Create dummy interfaces to ensure bridges are UP] ************************ Thursday 09 October 2025 21:04:43 +0000 (0:00:00.405) 0:00:55.438 ****** TASK [ci_nmstate : Ensure we have needed facts] ******************************** Thursday 09 October 2025 21:04:43 +0000 (0:00:00.071) 0:00:55.510 ****** skipping: [instance] TASK [ci_nmstate : Install required packages on instance] ********************** Thursday 09 October 2025 21:04:43 +0000 (0:00:00.041) 0:00:55.551 ****** ok: [instance] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Thursday 09 October 2025 21:04:44 +0000 (0:00:01.279) 0:00:56.830 ****** ok: [instance] TASK [ci_nmstate : Save nmstate state for instance] **************************** Thursday 09 October 2025 21:04:44 +0000 (0:00:00.211) 0:00:57.042 ****** changed: [instance] TASK [ci_nmstate : Apply the desidered state on instance] ********************** Thursday 09 October 2025 21:04:45 +0000 (0:00:00.376) 0:00:57.418 ****** changed: [instance] TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* Thursday 09 October 2025 21:04:46 +0000 (0:00:01.737) 0:00:59.156 ****** changed: [instance] TASK [Create extra network configuration] ************************************** Thursday 09 October 2025 21:04:47 +0000 (0:00:00.357) 0:00:59.514 ****** skipping: [instance] TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** Thursday 09 October 2025 21:04:47 +0000 (0:00:00.040) 0:00:59.554 ****** skipping: [instance] TASK [libvirt_manager : Refresh networking facts on host] ********************** Thursday 09 October 2025 21:04:47 +0000 (0:00:00.034) 0:00:59.589 ****** ok: [instance] TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** Thursday 09 October 2025 21:04:47 +0000 (0:00:00.459) 0:01:00.048 ****** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [dnsmasq : Install needed packages] *************************************** Thursday 09 October 2025 21:04:47 +0000 (0:00:00.149) 0:01:00.197 ****** ok: [instance] TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** Thursday 09 October 2025 21:04:49 +0000 (0:00:01.201) 0:01:01.398 ****** changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) TASK [dnsmasq : Manage configuration directory] ******************************** Thursday 09 October 2025 21:04:52 +0000 (0:00:03.838) 0:01:05.237 ****** changed: [instance] TASK [dnsmasq : Manage systemd unit file] ************************************** Thursday 09 October 2025 21:04:53 +0000 (0:00:00.230) 0:01:05.468 ****** changed: [instance] TASK [dnsmasq : Manage base configuration file] ******************************** Thursday 09 October 2025 21:04:53 +0000 (0:00:00.371) 0:01:05.839 ****** changed: [instance] TASK [dnsmasq : Render listener configuration] ********************************* Thursday 09 October 2025 21:04:53 +0000 (0:00:00.417) 0:01:06.256 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance TASK [dnsmasq : Create listener configuration file] **************************** Thursday 09 October 2025 21:04:53 +0000 (0:00:00.035) 0:01:06.292 ****** changed: [instance] TASK [dnsmasq : Remove listener configuration file] **************************** Thursday 09 October 2025 21:04:54 +0000 (0:00:00.433) 0:01:06.725 ****** skipping: [instance] TASK [dnsmasq : Render dns configuration] ************************************** Thursday 09 October 2025 21:04:54 +0000 (0:00:00.022) 0:01:06.748 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance TASK [dnsmasq : Create dns configuration file] ********************************* Thursday 09 October 2025 21:04:54 +0000 (0:00:00.037) 0:01:06.785 ****** changed: [instance] TASK [dnsmasq : Remove dns configuration file] ********************************* Thursday 09 October 2025 21:04:54 +0000 (0:00:00.423) 0:01:07.208 ****** skipping: [instance] TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** Thursday 09 October 2025 21:04:54 +0000 (0:00:00.023) 0:01:07.232 ****** ok: [instance] => (item=127.0.0.2) TASK [dnsmasq : Enable and start service] ************************************** Thursday 09 October 2025 21:04:55 +0000 (0:00:00.250) 0:01:07.483 ****** changed: [instance] TASK [dnsmasq : Stop service] ************************************************** Thursday 09 October 2025 21:04:55 +0000 (0:00:00.726) 0:01:08.209 ****** skipping: [instance] TASK [dnsmasq : Remove unit file] ********************************************** Thursday 09 October 2025 21:04:55 +0000 (0:00:00.023) 0:01:08.233 ****** skipping: [instance] TASK [dnsmasq : Remove main configuration files] ******************************* Thursday 09 October 2025 21:04:55 +0000 (0:00:00.021) 0:01:08.254 ****** skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) skipping: [instance] TASK [Create dnsmasq networks] ************************************************* Thursday 09 October 2025 21:04:55 +0000 (0:00:00.032) 0:01:08.287 ****** TASK [dnsmasq : Assert mandatory parameter] ************************************ Thursday 09 October 2025 21:04:56 +0000 (0:00:00.119) 0:01:08.407 ****** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Thursday 09 October 2025 21:04:56 +0000 (0:00:00.038) 0:01:08.445 ****** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Thursday 09 October 2025 21:04:56 +0000 (0:00:00.043) 0:01:08.489 ****** changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Thursday 09 October 2025 21:04:56 +0000 (0:00:00.489) 0:01:08.978 ****** skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Thursday 09 October 2025 21:04:56 +0000 (0:00:00.025) 0:01:09.004 ****** skipping: [instance] TASK [dnsmasq : Assert mandatory parameter] ************************************ Thursday 09 October 2025 21:04:56 +0000 (0:00:00.030) 0:01:09.035 ****** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Thursday 09 October 2025 21:04:56 +0000 (0:00:00.038) 0:01:09.073 ****** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Thursday 09 October 2025 21:04:56 +0000 (0:00:00.046) 0:01:09.119 ****** changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Thursday 09 October 2025 21:04:57 +0000 (0:00:00.453) 0:01:09.573 ****** skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Thursday 09 October 2025 21:04:57 +0000 (0:00:00.026) 0:01:09.599 ****** skipping: [instance] TASK [libvirt_manager : Ensure network is in correct zone] ********************* Thursday 09 October 2025 21:04:57 +0000 (0:00:00.032) 0:01:09.631 ****** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Thursday 09 October 2025 21:04:57 +0000 (0:00:00.544) 0:01:10.176 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Thursday 09 October 2025 21:04:57 +0000 (0:00:00.040) 0:01:10.216 ****** ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Thursday 09 October 2025 21:04:58 +0000 (0:00:00.355) 0:01:10.571 ****** ok: [instance] TASK [libvirt_manager : Extract IP address from network bridges] *************** Thursday 09 October 2025 21:04:58 +0000 (0:00:00.040) 0:01:10.611 ****** ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Thursday 09 October 2025 21:04:58 +0000 (0:00:00.214) 0:01:10.826 ****** ok: [instance] TASK [libvirt_manager : Output _network_data] ********************************** Thursday 09 October 2025 21:04:58 +0000 (0:00:00.038) 0:01:10.865 ****** changed: [instance] TASK [libvirt_manager : Output pub_net] **************************************** Thursday 09 October 2025 21:04:58 +0000 (0:00:00.367) 0:01:11.232 ****** changed: [instance] TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** Thursday 09 October 2025 21:04:59 +0000 (0:00:00.369) 0:01:11.601 ****** changed: [instance] TASK [libvirt_manager : Expose patch for networking_mapper] ******************** Thursday 09 October 2025 21:04:59 +0000 (0:00:00.368) 0:01:11.970 ****** ok: [instance] TASK [libvirt_manager : Save networking_mapper patch] ************************** Thursday 09 October 2025 21:04:59 +0000 (0:00:00.128) 0:01:12.099 ****** changed: [instance] TASK [networking_mapper : Check for Networking Definition file existence] ****** Thursday 09 October 2025 21:05:00 +0000 (0:00:00.362) 0:01:12.461 ****** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Thursday 09 October 2025 21:05:00 +0000 (0:00:00.028) 0:01:12.490 ****** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Thursday 09 October 2025 21:05:00 +0000 (0:00:00.026) 0:01:12.517 ****** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Thursday 09 October 2025 21:05:00 +0000 (0:00:00.026) 0:01:12.543 ****** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Thursday 09 October 2025 21:05:00 +0000 (0:00:00.025) 0:01:12.569 ****** ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Thursday 09 October 2025 21:05:00 +0000 (0:00:00.020) 0:01:12.589 ****** ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Thursday 09 October 2025 21:05:00 +0000 (0:00:00.122) 0:01:12.711 ****** skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Thursday 09 October 2025 21:05:00 +0000 (0:00:00.022) 0:01:12.733 ****** ok: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Thursday 09 October 2025 21:05:00 +0000 (0:00:00.219) 0:01:12.953 ****** changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Thursday 09 October 2025 21:05:01 +0000 (0:00:00.449) 0:01:13.402 ****** ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Thursday 09 October 2025 21:05:01 +0000 (0:00:00.068) 0:01:13.471 ****** ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Thursday 09 October 2025 21:05:01 +0000 (0:00:00.039) 0:01:13.510 ****** changed: [instance] TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** Thursday 09 October 2025 21:05:01 +0000 (0:00:00.450) 0:01:13.961 ****** ok: [instance] TASK [libvirt_manager : Unset patch] ******************************************* Thursday 09 October 2025 21:05:01 +0000 (0:00:00.037) 0:01:13.998 ****** ok: [instance] TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** Thursday 09 October 2025 21:05:01 +0000 (0:00:00.030) 0:01:14.028 ****** ok: [instance] TASK [libvirt_manager : Reserve IPs on networks] ******************************* Thursday 09 October 2025 21:05:01 +0000 (0:00:00.026) 0:01:14.054 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 09 October 2025 21:05:01 +0000 (0:00:00.083) 0:01:14.138 ****** ok: [instance] => (item=compute-0 - ctlplane) ok: [instance] => (item=controller-0 - ctlplane) ok: [instance] => (item=crc-0 - ctlplane) TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 09 October 2025 21:05:01 +0000 (0:00:00.133) 0:01:14.271 ****** skipping: [instance] => (item=compute-0 - internalapi) skipping: [instance] => (item=controller-0 - internalapi) skipping: [instance] => (item=crc-0 - internalapi) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 09 October 2025 21:05:02 +0000 (0:00:00.089) 0:01:14.361 ****** skipping: [instance] => (item=compute-0 - storage) skipping: [instance] => (item=controller-0 - storage) skipping: [instance] => (item=crc-0 - storage) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 09 October 2025 21:05:02 +0000 (0:00:00.086) 0:01:14.448 ****** skipping: [instance] => (item=compute-0 - tenant) skipping: [instance] => (item=controller-0 - tenant) skipping: [instance] => (item=crc-0 - tenant) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 09 October 2025 21:05:02 +0000 (0:00:00.089) 0:01:14.537 ****** skipping: [instance] => (item=compute-0 - external) skipping: [instance] => (item=controller-0 - external) skipping: [instance] => (item=crc-0 - external) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 09 October 2025 21:05:02 +0000 (0:00:00.086) 0:01:14.623 ****** skipping: [instance] => (item=compute-0 - storagemgmt) skipping: [instance] => (item=controller-0 - storagemgmt) skipping: [instance] => (item=crc-0 - storagemgmt) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Thursday 09 October 2025 21:05:02 +0000 (0:00:00.086) 0:01:14.710 ****** ok: [instance] => (item=compute-0 - public) ok: [instance] => (item=controller-0 - public) ok: [instance] => (item=crc-0 - public) TASK [Inject DHCP entries for net {{ net_name }}] ****************************** Thursday 09 October 2025 21:05:02 +0000 (0:00:00.135) 0:01:14.846 ****** TASK [dnsmasq : Ensure we have the right data and type] ************************ Thursday 09 October 2025 21:05:02 +0000 (0:00:00.117) 0:01:14.963 ****** ok: [instance] TASK [dnsmasq : Assert we have needed host data] ******************************* Thursday 09 October 2025 21:05:02 +0000 (0:00:00.046) 0:01:15.010 ****** ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:8c:a6:a2', 'ips': ['192.168.140.100', '']}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:b1:f6:b3', 'ips': ['192.168.140.9', '']}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:c3:23:81', 'ips': ['192.168.140.10', '']}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:65:9a:33', 'ips': ['192.168.101.100', '']}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:3c:58:1b', 'ips': ['192.168.101.9', '']}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:cf:9b:f3', 'ips': ['192.168.101.10', '']}) TASK [dnsmasq : Ensure networks exists] **************************************** Thursday 09 October 2025 21:05:02 +0000 (0:00:00.106) 0:01:15.117 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) TASK [dnsmasq : Check network file status] ************************************* Thursday 09 October 2025 21:05:02 +0000 (0:00:00.058) 0:01:15.175 ****** ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Thursday 09 October 2025 21:05:03 +0000 (0:00:00.194) 0:01:15.370 ****** ok: [instance] TASK [dnsmasq : Check network file status] ************************************* Thursday 09 October 2025 21:05:03 +0000 (0:00:00.029) 0:01:15.399 ****** ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Thursday 09 October 2025 21:05:03 +0000 (0:00:00.191) 0:01:15.591 ****** ok: [instance] TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** Thursday 09 October 2025 21:05:03 +0000 (0:00:00.031) 0:01:15.622 ****** ok: [instance] TASK [dnsmasq : Compute entry] ************************************************* Thursday 09 October 2025 21:05:03 +0000 (0:00:00.024) 0:01:15.647 ****** ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:8c:a6:a2', 'ips': ['192.168.140.100', '']}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:b1:f6:b3', 'ips': ['192.168.140.9', '']}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:c3:23:81', 'ips': ['192.168.140.10', '']}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:65:9a:33', 'ips': ['192.168.101.100', '']}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:3c:58:1b', 'ips': ['192.168.101.9', '']}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:cf:9b:f3', 'ips': ['192.168.101.10', '']}) TASK [dnsmasq : Create add/remove sets] **************************************** Thursday 09 October 2025 21:05:03 +0000 (0:00:00.176) 0:01:15.823 ****** ok: [instance] TASK [dnsmasq : Add DHCP entries] ********************************************** Thursday 09 October 2025 21:05:03 +0000 (0:00:00.043) 0:01:15.867 ****** changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:8c:a6:a2', 'entry': '52:54:00:8c:a6:a2,192.168.140.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:b1:f6:b3', 'entry': '52:54:01:b1:f6:b3,192.168.140.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:c3:23:81', 'entry': '52:54:02:c3:23:81,192.168.140.10,crc-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_compute-0_52:54:00:65:9a:33', 'entry': '52:54:00:65:9a:33,192.168.101.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_controller-0_52:54:01:3c:58:1b', 'entry': '52:54:01:3c:58:1b,192.168.101.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_crc-0_52:54:02:cf:9b:f3', 'entry': '52:54:02:cf:9b:f3,192.168.101.10,crc-0', 'state': 'present'}) TASK [dnsmasq : Remove DHCP entries] ******************************************* Thursday 09 October 2025 21:05:05 +0000 (0:00:02.194) 0:01:18.062 ****** skipping: [instance] TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** Thursday 09 October 2025 21:05:05 +0000 (0:00:00.029) 0:01:18.092 ****** ok: [instance] => (item=compute-0) ok: [instance] => (item=controller-0) ok: [instance] => (item=crc-0) TASK [Inject VMs in the .utility zone] ***************************************** Thursday 09 October 2025 21:05:05 +0000 (0:00:00.230) 0:01:18.322 ****** TASK [dnsmasq : Assert we have needed host record data] ************************ Thursday 09 October 2025 21:05:06 +0000 (0:00:00.119) 0:01:18.442 ****** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Thursday 09 October 2025 21:05:06 +0000 (0:00:00.128) 0:01:18.571 ****** ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Thursday 09 October 2025 21:05:06 +0000 (0:00:00.204) 0:01:18.776 ****** changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [libvirt_manager : Ensure some domains are local] ************************* Thursday 09 October 2025 21:05:09 +0000 (0:00:03.283) 0:01:22.060 ****** changed: [instance] TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ Thursday 09 October 2025 21:05:10 +0000 (0:00:00.375) 0:01:22.435 ****** RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Thursday 09 October 2025 21:05:10 +0000 (0:00:00.011) 0:01:22.446 ****** changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Thursday 09 October 2025 21:05:10 +0000 (0:00:00.815) 0:01:23.262 ****** changed: [instance] RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* Thursday 09 October 2025 21:05:11 +0000 (0:00:00.359) 0:01:23.621 ****** changed: [instance] TASK [reproducer : Delegate our domains to our own instance] ******************* Thursday 09 October 2025 21:05:11 +0000 (0:00:00.345) 0:01:23.967 ****** changed: [instance] TASK [reproducer : Ensure "utility" domain is local] *************************** Thursday 09 October 2025 21:05:11 +0000 (0:00:00.362) 0:01:24.330 ****** changed: [instance] TASK [Build utility records dataset] ******************************************* Thursday 09 October 2025 21:05:12 +0000 (0:00:00.369) 0:01:24.699 ****** TASK [dnsmasq : Assert we have needed host record data] ************************ Thursday 09 October 2025 21:05:12 +0000 (0:00:00.031) 0:01:24.731 ****** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Thursday 09 October 2025 21:05:12 +0000 (0:00:00.093) 0:01:24.824 ****** ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Thursday 09 October 2025 21:05:12 +0000 (0:00:00.103) 0:01:24.927 ****** changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [reproducer : Flush handlers] ********************************************* Thursday 09 October 2025 21:05:13 +0000 (0:00:00.471) 0:01:25.399 ****** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Thursday 09 October 2025 21:05:13 +0000 (0:00:00.010) 0:01:25.409 ****** changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Thursday 09 October 2025 21:05:13 +0000 (0:00:00.480) 0:01:25.889 ****** changed: [instance] TASK [reproducer : Bootstrap nat64 if needed] ********************************** Thursday 09 October 2025 21:05:14 +0000 (0:00:01.388) 0:01:27.278 ****** skipping: [instance] TASK [reproducer : Deploy CRC if needed] *************************************** Thursday 09 October 2025 21:05:14 +0000 (0:00:00.036) 0:01:27.314 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance TASK [reproducer : Check for CRC availability in known path] ******************* Thursday 09 October 2025 21:05:15 +0000 (0:00:00.111) 0:01:27.426 ****** ok: [instance] TASK [Deploy CRC if needed] **************************************************** Thursday 09 October 2025 21:05:15 +0000 (0:00:00.194) 0:01:27.620 ****** skipping: [instance] TASK [rhol_crc : Stop CRC VM] ************************************************** Thursday 09 October 2025 21:05:15 +0000 (0:00:00.022) 0:01:27.643 ****** ok: [instance] TASK [rhol_crc : Undefine CRC VM] ********************************************** Thursday 09 October 2025 21:05:15 +0000 (0:00:00.367) 0:01:28.011 ****** ok: [instance] TASK [rhol_crc : Destroy CRC network] ****************************************** Thursday 09 October 2025 21:05:15 +0000 (0:00:00.245) 0:01:28.257 ****** ok: [instance] TASK [rhol_crc : Undefine CRC network] ***************************************** Thursday 09 October 2025 21:05:16 +0000 (0:00:00.225) 0:01:28.482 ****** ok: [instance] TASK [rhol_crc : Destroy default network] ************************************** Thursday 09 October 2025 21:05:16 +0000 (0:00:00.225) 0:01:28.708 ****** ok: [instance] TASK [Check if new ssh keypair exists] ***************************************** Thursday 09 October 2025 21:05:16 +0000 (0:00:00.234) 0:01:28.942 ****** TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Thursday 09 October 2025 21:05:16 +0000 (0:00:00.042) 0:01:28.985 ****** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Thursday 09 October 2025 21:05:16 +0000 (0:00:00.199) 0:01:29.185 ****** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Thursday 09 October 2025 21:05:16 +0000 (0:00:00.023) 0:01:29.209 ****** skipping: [instance] TASK [reproducer : Slurp ssh key for CRC access] ******************************* Thursday 09 October 2025 21:05:16 +0000 (0:00:00.025) 0:01:29.234 ****** ok: [instance] TASK [reproducer : Get kubeconfig file from crc directory] ********************* Thursday 09 October 2025 21:05:17 +0000 (0:00:00.260) 0:01:29.494 ****** ok: [instance] TASK [reproducer : Get kubeadmin-password file from crc directory] ************* Thursday 09 October 2025 21:05:17 +0000 (0:00:00.225) 0:01:29.719 ****** ok: [instance] TASK [Ensure we expose openshift_login related facts] ************************** Thursday 09 October 2025 21:05:17 +0000 (0:00:00.183) 0:01:29.902 ****** TASK [openshift_login : Assert we have needed parameters] ********************** Thursday 09 October 2025 21:05:17 +0000 (0:00:00.060) 0:01:29.963 ****** ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Stat kubeconfig] *************************************** Thursday 09 October 2025 21:05:17 +0000 (0:00:00.044) 0:01:30.007 ****** ok: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Thursday 09 October 2025 21:05:17 +0000 (0:00:00.179) 0:01:30.186 ****** ok: [instance] TASK [openshift_login : Assert files exist] ************************************ Thursday 09 October 2025 21:05:18 +0000 (0:00:00.195) 0:01:30.382 ****** ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Gather the password of the deployed cluster.] ********** Thursday 09 October 2025 21:05:18 +0000 (0:00:00.025) 0:01:30.407 ****** ok: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Thursday 09 October 2025 21:05:18 +0000 (0:00:00.192) 0:01:30.600 ****** ok: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Thursday 09 October 2025 21:05:18 +0000 (0:00:00.179) 0:01:30.780 ****** ok: [instance] TASK [reproducer : Remove CRC managed zone delegation] ************************* Thursday 09 October 2025 21:05:18 +0000 (0:00:00.050) 0:01:30.831 ****** changed: [instance] => (item=dnsmasq.d/crc.conf) changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ Thursday 09 October 2025 21:05:18 +0000 (0:00:00.404) 0:01:31.236 ****** skipping: [instance] TASK [Load the architecture local kustomize patches] *************************** Thursday 09 October 2025 21:05:18 +0000 (0:00:00.025) 0:01:31.262 ****** skipping: [instance] TASK [reproducer : Consume libvirt_manager] ************************************ Thursday 09 October 2025 21:05:18 +0000 (0:00:00.035) 0:01:31.298 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance TASK [libvirt_manager : Import layout generator if needed] ********************* Thursday 09 October 2025 21:05:19 +0000 (0:00:00.135) 0:01:31.433 ****** skipping: [instance] TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** Thursday 09 October 2025 21:05:19 +0000 (0:00:00.035) 0:01:31.469 ****** changed: [instance] TASK [libvirt_manager : Enable masquerading for public traffic] **************** Thursday 09 October 2025 21:05:19 +0000 (0:00:00.434) 0:01:31.904 ****** changed: [instance] TASK [libvirt_manager : Ensure firewalld is restarts] ************************** Thursday 09 October 2025 21:05:20 +0000 (0:00:00.583) 0:01:32.487 ****** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Thursday 09 October 2025 21:05:20 +0000 (0:00:00.011) 0:01:32.499 ****** changed: [instance] RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Thursday 09 October 2025 21:05:20 +0000 (0:00:00.436) 0:01:32.935 ****** changed: [instance] TASK [Deploy virtualbmc] ******************************************************* Thursday 09 October 2025 21:05:21 +0000 (0:00:00.864) 0:01:33.799 ****** skipping: [instance] TASK [libvirt_manager : Let the project know we have vbmc available] *********** Thursday 09 October 2025 21:05:21 +0000 (0:00:00.035) 0:01:33.835 ****** skipping: [instance] TASK [libvirt_manager : Create needed workload directory] ********************** Thursday 09 October 2025 21:05:21 +0000 (0:00:00.035) 0:01:33.871 ****** changed: [instance] => (item=workload) changed: [instance] => (item=reproducer-inventory) ok: [instance] => (item=volumes) TASK [libvirt_manager : Allow QEMU on workload directory] ********************** Thursday 09 October 2025 21:05:22 +0000 (0:00:00.585) 0:01:34.456 ****** changed: [instance] => (item=workload) changed: [instance] => (item=volumes) TASK [libvirt_manager : Generate networking data] ****************************** Thursday 09 October 2025 21:05:22 +0000 (0:00:00.467) 0:01:34.924 ****** skipping: [instance] TASK [libvirt_manager : Create group inventories] ****************************** Thursday 09 October 2025 21:05:22 +0000 (0:00:00.028) 0:01:34.953 ****** changed: [instance] => (item=compute) changed: [instance] => (item=controller) changed: [instance] => (item=crc) TASK [libvirt_manager : Create "all" group inventory file] ********************* Thursday 09 October 2025 21:05:23 +0000 (0:00:01.043) 0:01:35.996 ****** changed: [instance] TASK [libvirt_manager : Ensure storage pool is present.] *********************** Thursday 09 October 2025 21:05:24 +0000 (0:00:00.372) 0:01:36.369 ****** skipping: [instance] TASK [libvirt_manager : Ensure images are present] ***************************** Thursday 09 October 2025 21:05:24 +0000 (0:00:00.039) 0:01:36.408 ****** skipping: [instance] => (item=crc) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) TASK [libvirt_manager : Ensure directory exists] ******************************* Thursday 09 October 2025 21:05:24 +0000 (0:00:00.063) 0:01:36.471 ****** changed: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Thursday 09 October 2025 21:05:24 +0000 (0:00:00.207) 0:01:36.679 ****** ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Thursday 09 October 2025 21:05:24 +0000 (0:00:00.182) 0:01:36.861 ****** changed: [instance] TASK [libvirt_manager : Check image] ******************************************* Thursday 09 October 2025 21:05:45 +0000 (0:00:21.144) 0:01:58.006 ****** ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Thursday 09 October 2025 21:05:45 +0000 (0:00:00.217) 0:01:58.224 ****** ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Thursday 09 October 2025 21:05:45 +0000 (0:00:00.040) 0:01:58.265 ****** changed: [instance] TASK [libvirt_manager : Ensure directory exists] ******************************* Thursday 09 October 2025 21:05:46 +0000 (0:00:00.232) 0:01:58.497 ****** ok: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Thursday 09 October 2025 21:05:46 +0000 (0:00:00.215) 0:01:58.712 ****** ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Thursday 09 October 2025 21:05:46 +0000 (0:00:00.205) 0:01:58.918 ****** skipping: [instance] TASK [libvirt_manager : Check image] ******************************************* Thursday 09 October 2025 21:05:46 +0000 (0:00:00.023) 0:01:58.941 ****** ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Thursday 09 October 2025 21:05:46 +0000 (0:00:00.223) 0:01:59.165 ****** ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Thursday 09 October 2025 21:05:46 +0000 (0:00:00.051) 0:01:59.216 ****** ok: [instance] TASK [libvirt_manager : Get ssh key state] ************************************* Thursday 09 October 2025 21:05:47 +0000 (0:00:00.237) 0:01:59.454 ****** ok: [instance] TASK [libvirt_manager : Create temporary ssh keypair] ************************** Thursday 09 October 2025 21:05:47 +0000 (0:00:00.198) 0:01:59.652 ****** changed: [instance] TASK [libvirt_manager : Slurp public key for later use] ************************ Thursday 09 October 2025 21:05:47 +0000 (0:00:00.450) 0:02:00.102 ****** ok: [instance] TASK [libvirt_manager : Slurp private key for later use] *********************** Thursday 09 October 2025 21:05:47 +0000 (0:00:00.204) 0:02:00.307 ****** ok: [instance] TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** Thursday 09 October 2025 21:05:48 +0000 (0:00:00.195) 0:02:00.503 ****** changed: [instance] TASK [libvirt_manager : Create fact holding network data for VMs] ************** Thursday 09 October 2025 21:05:48 +0000 (0:00:00.454) 0:02:00.958 ****** ok: [instance] TASK [libvirt_manager : List existing networks] ******************************** Thursday 09 October 2025 21:05:48 +0000 (0:00:00.029) 0:02:00.987 ****** ok: [instance] TASK [libvirt_manager : Gather pool fact] ************************************** Thursday 09 October 2025 21:05:48 +0000 (0:00:00.239) 0:02:01.227 ****** ok: [instance] TASK [libvirt_manager : Create and run VMs] ************************************ Thursday 09 October 2025 21:05:49 +0000 (0:00:00.517) 0:02:01.744 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Create VM image for compute-0] ************************* Thursday 09 October 2025 21:05:49 +0000 (0:00:00.124) 0:02:01.869 ****** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** Thursday 09 October 2025 21:05:49 +0000 (0:00:00.276) 0:02:02.145 ****** changed: [instance] TASK [libvirt_manager : Define VMs for type compute-0] ************************* Thursday 09 October 2025 21:05:50 +0000 (0:00:00.250) 0:02:02.395 ****** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** Thursday 09 October 2025 21:05:50 +0000 (0:00:00.351) 0:02:02.747 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Thursday 09 October 2025 21:05:50 +0000 (0:00:00.032) 0:02:02.779 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Thursday 09 October 2025 21:05:50 +0000 (0:00:00.097) 0:02:02.876 ****** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 09 October 2025 21:05:50 +0000 (0:00:00.256) 0:02:03.133 ****** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 09 October 2025 21:05:50 +0000 (0:00:00.052) 0:02:03.185 ****** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 09 October 2025 21:05:51 +0000 (0:00:00.253) 0:02:03.438 ****** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ Thursday 09 October 2025 21:05:51 +0000 (0:00:00.219) 0:02:03.658 ****** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Thursday 09 October 2025 21:05:51 +0000 (0:00:00.319) 0:02:03.978 ****** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 09 October 2025 21:05:51 +0000 (0:00:00.253) 0:02:04.231 ****** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 09 October 2025 21:05:51 +0000 (0:00:00.050) 0:02:04.282 ****** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 09 October 2025 21:05:52 +0000 (0:00:00.259) 0:02:04.541 ****** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* Thursday 09 October 2025 21:05:52 +0000 (0:00:00.215) 0:02:04.756 ****** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** Thursday 09 October 2025 21:05:52 +0000 (0:00:00.308) 0:02:05.065 ****** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** Thursday 09 October 2025 21:05:52 +0000 (0:00:00.022) 0:02:05.088 ****** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** Thursday 09 October 2025 21:05:52 +0000 (0:00:00.031) 0:02:05.119 ****** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** Thursday 09 October 2025 21:05:52 +0000 (0:00:00.031) 0:02:05.151 ****** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Thursday 09 October 2025 21:05:52 +0000 (0:00:00.028) 0:02:05.179 ****** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Thursday 09 October 2025 21:05:53 +0000 (0:00:00.234) 0:02:05.414 ****** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Thursday 09 October 2025 21:05:53 +0000 (0:00:00.041) 0:02:05.455 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Thursday 09 October 2025 21:05:53 +0000 (0:00:00.059) 0:02:05.515 ****** ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Thursday 09 October 2025 21:05:53 +0000 (0:00:00.212) 0:02:05.727 ****** ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Thursday 09 October 2025 21:05:53 +0000 (0:00:00.067) 0:02:05.795 ****** ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Thursday 09 October 2025 21:05:53 +0000 (0:00:00.053) 0:02:05.848 ****** skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Thursday 09 October 2025 21:05:53 +0000 (0:00:00.055) 0:02:05.904 ****** skipping: [instance] TASK [Call the config_drive role] ********************************************** Thursday 09 October 2025 21:05:53 +0000 (0:00:00.051) 0:02:05.955 ****** TASK [config_drive : Ensure needed directories exist] ************************** Thursday 09 October 2025 21:05:53 +0000 (0:00:00.070) 0:02:06.026 ****** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Thursday 09 October 2025 21:05:54 +0000 (0:00:00.447) 0:02:06.474 ****** ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Thursday 09 October 2025 21:05:55 +0000 (0:00:01.215) 0:02:07.689 ****** changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Thursday 09 October 2025 21:05:55 +0000 (0:00:00.251) 0:02:07.941 ****** changed: [instance] TASK [config_drive : Generate user-data] *************************************** Thursday 09 October 2025 21:05:56 +0000 (0:00:00.415) 0:02:08.357 ****** changed: [instance] TASK [config_drive : Generate network-data] ************************************ Thursday 09 October 2025 21:05:56 +0000 (0:00:00.395) 0:02:08.753 ****** skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Thursday 09 October 2025 21:05:56 +0000 (0:00:00.046) 0:02:08.800 ****** ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Thursday 09 October 2025 21:05:56 +0000 (0:00:00.214) 0:02:09.014 ****** skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Thursday 09 October 2025 21:05:56 +0000 (0:00:00.048) 0:02:09.063 ****** Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Thursday 09 October 2025 21:05:56 +0000 (0:00:00.242) 0:02:09.306 ****** changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Thursday 09 October 2025 21:05:57 +0000 (0:00:00.307) 0:02:09.613 ****** skipping: [instance] TASK [libvirt_manager : Create VM image for controller-0] ********************** Thursday 09 October 2025 21:05:57 +0000 (0:00:00.054) 0:02:09.668 ****** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** Thursday 09 October 2025 21:05:57 +0000 (0:00:00.274) 0:02:09.942 ****** changed: [instance] TASK [libvirt_manager : Define VMs for type controller-0] ********************** Thursday 09 October 2025 21:05:57 +0000 (0:00:00.265) 0:02:10.208 ****** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** Thursday 09 October 2025 21:05:58 +0000 (0:00:00.428) 0:02:10.637 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Thursday 09 October 2025 21:05:58 +0000 (0:00:00.034) 0:02:10.672 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Thursday 09 October 2025 21:05:58 +0000 (0:00:00.047) 0:02:10.719 ****** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 09 October 2025 21:05:58 +0000 (0:00:00.252) 0:02:10.971 ****** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 09 October 2025 21:05:58 +0000 (0:00:00.051) 0:02:11.023 ****** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 09 October 2025 21:05:58 +0000 (0:00:00.254) 0:02:11.277 ****** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* Thursday 09 October 2025 21:05:59 +0000 (0:00:00.215) 0:02:11.493 ****** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Thursday 09 October 2025 21:05:59 +0000 (0:00:00.316) 0:02:11.809 ****** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 09 October 2025 21:05:59 +0000 (0:00:00.259) 0:02:12.068 ****** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 09 October 2025 21:05:59 +0000 (0:00:00.051) 0:02:12.119 ****** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 09 October 2025 21:06:00 +0000 (0:00:00.253) 0:02:12.373 ****** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** Thursday 09 October 2025 21:06:00 +0000 (0:00:00.230) 0:02:12.603 ****** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** Thursday 09 October 2025 21:06:00 +0000 (0:00:00.307) 0:02:12.911 ****** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** Thursday 09 October 2025 21:06:00 +0000 (0:00:00.030) 0:02:12.942 ****** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** Thursday 09 October 2025 21:06:00 +0000 (0:00:00.033) 0:02:12.975 ****** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** Thursday 09 October 2025 21:06:00 +0000 (0:00:00.037) 0:02:13.013 ****** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Thursday 09 October 2025 21:06:00 +0000 (0:00:00.031) 0:02:13.044 ****** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Thursday 09 October 2025 21:06:00 +0000 (0:00:00.241) 0:02:13.285 ****** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Thursday 09 October 2025 21:06:00 +0000 (0:00:00.047) 0:02:13.333 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Thursday 09 October 2025 21:06:01 +0000 (0:00:00.059) 0:02:13.392 ****** ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Thursday 09 October 2025 21:06:01 +0000 (0:00:00.221) 0:02:13.614 ****** ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Thursday 09 October 2025 21:06:01 +0000 (0:00:00.071) 0:02:13.685 ****** ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Thursday 09 October 2025 21:06:01 +0000 (0:00:00.054) 0:02:13.740 ****** skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Thursday 09 October 2025 21:06:01 +0000 (0:00:00.048) 0:02:13.788 ****** skipping: [instance] TASK [Call the config_drive role] ********************************************** Thursday 09 October 2025 21:06:01 +0000 (0:00:00.046) 0:02:13.835 ****** TASK [config_drive : Ensure needed directories exist] ************************** Thursday 09 October 2025 21:06:01 +0000 (0:00:00.061) 0:02:13.896 ****** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Thursday 09 October 2025 21:06:01 +0000 (0:00:00.419) 0:02:14.316 ****** ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Thursday 09 October 2025 21:06:03 +0000 (0:00:01.216) 0:02:15.532 ****** changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Thursday 09 October 2025 21:06:03 +0000 (0:00:00.227) 0:02:15.760 ****** changed: [instance] TASK [config_drive : Generate user-data] *************************************** Thursday 09 October 2025 21:06:03 +0000 (0:00:00.409) 0:02:16.170 ****** changed: [instance] TASK [config_drive : Generate network-data] ************************************ Thursday 09 October 2025 21:06:04 +0000 (0:00:00.414) 0:02:16.584 ****** skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Thursday 09 October 2025 21:06:04 +0000 (0:00:00.051) 0:02:16.636 ****** ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Thursday 09 October 2025 21:06:04 +0000 (0:00:00.214) 0:02:16.850 ****** skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Thursday 09 October 2025 21:06:04 +0000 (0:00:00.047) 0:02:16.898 ****** Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Thursday 09 October 2025 21:06:04 +0000 (0:00:00.248) 0:02:17.146 ****** changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Thursday 09 October 2025 21:06:05 +0000 (0:00:00.291) 0:02:17.438 ****** skipping: [instance] TASK [libvirt_manager : Create VM image for crc-0] ***************************** Thursday 09 October 2025 21:06:05 +0000 (0:00:00.052) 0:02:17.490 ****** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ Thursday 09 October 2025 21:06:05 +0000 (0:00:00.268) 0:02:17.758 ****** changed: [instance] TASK [libvirt_manager : Define VMs for type crc-0] ***************************** Thursday 09 October 2025 21:06:05 +0000 (0:00:00.237) 0:02:17.996 ****** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** Thursday 09 October 2025 21:06:06 +0000 (0:00:00.356) 0:02:18.352 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Thursday 09 October 2025 21:06:06 +0000 (0:00:00.030) 0:02:18.383 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Thursday 09 October 2025 21:06:06 +0000 (0:00:00.044) 0:02:18.427 ****** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 09 October 2025 21:06:06 +0000 (0:00:00.244) 0:02:18.672 ****** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 09 October 2025 21:06:06 +0000 (0:00:00.044) 0:02:18.717 ****** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 09 October 2025 21:06:06 +0000 (0:00:00.249) 0:02:18.966 ****** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** Thursday 09 October 2025 21:06:06 +0000 (0:00:00.216) 0:02:19.182 ****** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Thursday 09 October 2025 21:06:07 +0000 (0:00:00.351) 0:02:19.533 ****** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Thursday 09 October 2025 21:06:07 +0000 (0:00:00.267) 0:02:19.801 ****** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Thursday 09 October 2025 21:06:07 +0000 (0:00:00.050) 0:02:19.851 ****** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Thursday 09 October 2025 21:06:07 +0000 (0:00:00.245) 0:02:20.096 ****** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* Thursday 09 October 2025 21:06:07 +0000 (0:00:00.216) 0:02:20.313 ****** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* Thursday 09 October 2025 21:06:08 +0000 (0:00:00.311) 0:02:20.624 ****** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ Thursday 09 October 2025 21:06:08 +0000 (0:00:00.029) 0:02:20.654 ****** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** Thursday 09 October 2025 21:06:08 +0000 (0:00:00.034) 0:02:20.688 ****** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** Thursday 09 October 2025 21:06:08 +0000 (0:00:00.031) 0:02:20.720 ****** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Thursday 09 October 2025 21:06:08 +0000 (0:00:00.027) 0:02:20.748 ****** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Thursday 09 October 2025 21:06:08 +0000 (0:00:00.224) 0:02:20.972 ****** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Thursday 09 October 2025 21:06:08 +0000 (0:00:00.041) 0:02:21.014 ****** skipping: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Thursday 09 October 2025 21:06:08 +0000 (0:00:00.035) 0:02:21.049 ****** skipping: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Thursday 09 October 2025 21:06:08 +0000 (0:00:00.032) 0:02:21.082 ****** skipping: [instance] TASK [libvirt_manager : Start (power-on) VMs] ********************************** Thursday 09 October 2025 21:06:08 +0000 (0:00:00.055) 0:02:21.137 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** Thursday 09 October 2025 21:06:08 +0000 (0:00:00.065) 0:02:21.203 ****** ok: [instance] => (item=crc) TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** Thursday 09 October 2025 21:06:09 +0000 (0:00:00.254) 0:02:21.458 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Start vm] ********************************************** Thursday 09 October 2025 21:06:11 +0000 (0:00:02.075) 0:02:23.533 ****** changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Thursday 09 October 2025 21:06:12 +0000 (0:00:00.951) 0:02:24.485 ****** changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Thursday 09 October 2025 21:06:13 +0000 (0:00:00.910) 0:02:25.396 ****** changed: [instance] TASK [libvirt_manager : Wait for SSH on started VMs] *************************** Thursday 09 October 2025 21:06:13 +0000 (0:00:00.925) 0:02:26.322 ****** changed: [instance] => (item=compute-0.utility) changed: [instance] => (item=controller-0.utility) changed: [instance] => (item=crc-0.utility) TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** Thursday 09 October 2025 21:06:14 +0000 (0:00:00.793) 0:02:27.115 ****** FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j429523261126.23994', 'results_file': '/home/zuul/.ansible_async/j429523261126.23994', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j139429523359.24011', 'results_file': '/home/zuul/.ansible_async/j139429523359.24011', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j181972631963.24027', 'results_file': '/home/zuul/.ansible_async/j181972631963.24027', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) TASK [libvirt_manager : Configure managed VMs] ********************************* Thursday 09 October 2025 21:06:34 +0000 (0:00:19.985) 0:02:47.101 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [Check if new ssh keypair exists] ***************************************** Thursday 09 October 2025 21:06:34 +0000 (0:00:00.136) 0:02:47.237 ****** skipping: [instance] TASK [Push ssh jumper/configuration for compute-0] ***************************** Thursday 09 October 2025 21:06:34 +0000 (0:00:00.029) 0:02:47.266 ****** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Thursday 09 October 2025 21:06:34 +0000 (0:00:00.045) 0:02:47.311 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Thursday 09 October 2025 21:06:35 +0000 (0:00:00.093) 0:02:47.405 ****** changed: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Thursday 09 October 2025 21:06:35 +0000 (0:00:00.243) 0:02:47.648 ****** changed: [instance] TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* Thursday 09 October 2025 21:06:35 +0000 (0:00:00.245) 0:02:47.894 ****** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** Thursday 09 October 2025 21:06:35 +0000 (0:00:00.408) 0:02:48.303 ****** skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Thursday 09 October 2025 21:06:35 +0000 (0:00:00.037) 0:02:48.340 ****** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** Thursday 09 October 2025 21:06:36 +0000 (0:00:00.037) 0:02:48.378 ****** skipping: [instance] TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** Thursday 09 October 2025 21:06:36 +0000 (0:00:00.056) 0:02:48.435 ****** skipping: [instance] TASK [Check if new ssh keypair exists] ***************************************** Thursday 09 October 2025 21:06:36 +0000 (0:00:00.051) 0:02:48.486 ****** skipping: [instance] TASK [Push ssh jumper/configuration for controller-0] ************************** Thursday 09 October 2025 21:06:36 +0000 (0:00:00.029) 0:02:48.516 ****** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Thursday 09 October 2025 21:06:36 +0000 (0:00:00.038) 0:02:48.555 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Thursday 09 October 2025 21:06:36 +0000 (0:00:00.080) 0:02:48.635 ****** ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Thursday 09 October 2025 21:06:36 +0000 (0:00:00.314) 0:02:48.949 ****** ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** Thursday 09 October 2025 21:06:36 +0000 (0:00:00.212) 0:02:49.162 ****** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** Thursday 09 October 2025 21:06:37 +0000 (0:00:00.414) 0:02:49.576 ****** skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Thursday 09 October 2025 21:06:37 +0000 (0:00:00.034) 0:02:49.610 ****** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts controller-0] ************** Thursday 09 October 2025 21:06:37 +0000 (0:00:00.034) 0:02:49.644 ****** changed: [instance -> controller-0.instance] TASK [libvirt_manager : Inject public key on hosts controller-0] *************** Thursday 09 October 2025 21:06:38 +0000 (0:00:01.585) 0:02:51.230 ****** changed: [instance -> controller-0.instance] TASK [Check if new ssh keypair exists] ***************************************** Thursday 09 October 2025 21:06:40 +0000 (0:00:01.185) 0:02:52.415 ****** TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Thursday 09 October 2025 21:06:40 +0000 (0:00:00.042) 0:02:52.458 ****** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Thursday 09 October 2025 21:06:40 +0000 (0:00:00.230) 0:02:52.689 ****** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Thursday 09 October 2025 21:06:40 +0000 (0:00:00.028) 0:02:52.718 ****** skipping: [instance] TASK [Push ssh jumper/configuration for crc-0] ********************************* Thursday 09 October 2025 21:06:40 +0000 (0:00:00.041) 0:02:52.759 ****** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Thursday 09 October 2025 21:06:40 +0000 (0:00:00.053) 0:02:52.813 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Thursday 09 October 2025 21:06:40 +0000 (0:00:00.094) 0:02:52.908 ****** ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Thursday 09 October 2025 21:06:40 +0000 (0:00:00.238) 0:02:53.146 ****** ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** Thursday 09 October 2025 21:06:41 +0000 (0:00:00.240) 0:02:53.387 ****** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** Thursday 09 October 2025 21:06:41 +0000 (0:00:00.398) 0:02:53.785 ****** changed: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Thursday 09 October 2025 21:06:42 +0000 (0:00:00.795) 0:02:54.580 ****** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* Thursday 09 October 2025 21:06:42 +0000 (0:00:00.039) 0:02:54.620 ****** skipping: [instance] TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** Thursday 09 October 2025 21:06:42 +0000 (0:00:00.056) 0:02:54.676 ****** skipping: [instance] TASK [Create VBMC entity] ****************************************************** Thursday 09 October 2025 21:06:42 +0000 (0:00:00.050) 0:02:54.726 ****** skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) skipping: [instance] TASK [libvirt_manager : List running virtual machines.] ************************ Thursday 09 October 2025 21:06:42 +0000 (0:00:00.053) 0:02:54.780 ****** ok: [instance] TASK [libvirt_manager : Dump UUIDs] ******************************************** Thursday 09 October 2025 21:06:42 +0000 (0:00:00.259) 0:02:55.040 ****** changed: [instance] TASK [Ensure fresh vbmc listing] *********************************************** Thursday 09 October 2025 21:06:43 +0000 (0:00:00.429) 0:02:55.469 ****** skipping: [instance] TASK [libvirt_manager : Update vbmc related fact] ****************************** Thursday 09 October 2025 21:06:43 +0000 (0:00:00.040) 0:02:55.509 ****** skipping: [instance] TASK [libvirt_manager : Dump vbmc known hosts] ********************************* Thursday 09 October 2025 21:06:43 +0000 (0:00:00.044) 0:02:55.553 ****** skipping: [instance] TASK [libvirt_manager : Copy authorized_keys] ********************************** Thursday 09 October 2025 21:06:43 +0000 (0:00:00.040) 0:02:55.594 ****** changed: [instance] TASK [libvirt_manager : Enable root access on CRC] ***************************** Thursday 09 October 2025 21:06:43 +0000 (0:00:00.699) 0:02:56.294 ****** changed: [instance] TASK [reproducer : Get deployed VM group inventories] ************************** Thursday 09 October 2025 21:06:44 +0000 (0:00:00.704) 0:02:56.998 ****** skipping: [instance] TASK [reproducer : Inject remote inventories onto main hypervisor] ************* Thursday 09 October 2025 21:06:44 +0000 (0:00:00.052) 0:02:57.051 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) TASK [reproducer : Gather inventories from instance] *************************** Thursday 09 October 2025 21:06:44 +0000 (0:00:00.073) 0:02:57.124 ****** skipping: [instance] TASK [reproducer : Gather inventories from compute-0] ************************** Thursday 09 October 2025 21:06:44 +0000 (0:00:00.054) 0:02:57.178 ****** skipping: [instance] TASK [reproducer : Gather inventories from controller-0] *********************** Thursday 09 October 2025 21:06:44 +0000 (0:00:00.047) 0:02:57.226 ****** skipping: [instance] TASK [reproducer : Gather inventories from crc-0] ****************************** Thursday 09 October 2025 21:06:44 +0000 (0:00:00.044) 0:02:57.271 ****** skipping: [instance] TASK [reproducer : Push generated inventory from hypervisor] ******************* Thursday 09 October 2025 21:06:44 +0000 (0:00:00.046) 0:02:57.317 ****** changed: [instance] TASK [reproducer : Slurp devscripts private key] ******************************* Thursday 09 October 2025 21:06:45 +0000 (0:00:00.696) 0:02:58.014 ****** skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** Thursday 09 October 2025 21:06:45 +0000 (0:00:00.043) 0:02:58.057 ****** skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* Thursday 09 October 2025 21:06:45 +0000 (0:00:00.039) 0:02:58.097 ****** skipping: [instance] TASK [openshift_login : Assert we have needed parameters] ********************** Thursday 09 October 2025 21:06:45 +0000 (0:00:00.043) 0:02:58.140 ****** skipping: [instance] TASK [openshift_login : Stat kubeconfig] *************************************** Thursday 09 October 2025 21:06:45 +0000 (0:00:00.043) 0:02:58.183 ****** skipping: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Thursday 09 October 2025 21:06:45 +0000 (0:00:00.039) 0:02:58.222 ****** skipping: [instance] TASK [openshift_login : Assert files exist] ************************************ Thursday 09 October 2025 21:06:45 +0000 (0:00:00.036) 0:02:58.259 ****** skipping: [instance] TASK [openshift_login : Gather the password of the deployed cluster.] ********** Thursday 09 October 2025 21:06:45 +0000 (0:00:00.035) 0:02:58.295 ****** skipping: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Thursday 09 October 2025 21:06:45 +0000 (0:00:00.034) 0:02:58.329 ****** skipping: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Thursday 09 October 2025 21:06:46 +0000 (0:00:00.038) 0:02:58.368 ****** skipping: [instance] TASK [reproducer : Set fact for later wait on OCP cluster] ********************* Thursday 09 October 2025 21:06:46 +0000 (0:00:00.052) 0:02:58.420 ****** skipping: [instance] TASK [reproducer : Configure Controller node] ********************************** Thursday 09 October 2025 21:06:46 +0000 (0:00:00.040) 0:02:58.461 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance TASK [reproducer : Set facts related to the reproducer] ************************ Thursday 09 October 2025 21:06:46 +0000 (0:00:00.228) 0:02:58.689 ****** ok: [instance] TASK [reproducer : Ensure directories exist] *********************************** Thursday 09 October 2025 21:06:46 +0000 (0:00:00.044) 0:02:58.734 ****** changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Tweak dnf configuration] ************************************ Thursday 09 October 2025 21:06:47 +0000 (0:00:01.581) 0:03:00.315 ****** skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Thursday 09 October 2025 21:06:48 +0000 (0:00:00.029) 0:03:00.345 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Thursday 09 October 2025 21:06:48 +0000 (0:00:00.790) 0:03:01.135 ****** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Thursday 09 October 2025 21:06:48 +0000 (0:00:00.043) 0:03:01.179 ****** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Thursday 09 October 2025 21:06:48 +0000 (0:00:00.046) 0:03:01.225 ****** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Thursday 09 October 2025 21:06:48 +0000 (0:00:00.041) 0:03:01.266 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get rhos-release] ******************************************* Thursday 09 October 2025 21:06:50 +0000 (0:00:01.652) 0:03:02.919 ****** skipping: [instance] TASK [reproducer : Install repos] ********************************************** Thursday 09 October 2025 21:06:50 +0000 (0:00:00.049) 0:03:02.968 ****** skipping: [instance] TASK [reproducer : Run custom commands after rhos-release setup] *************** Thursday 09 October 2025 21:06:50 +0000 (0:00:00.040) 0:03:03.009 ****** skipping: [instance] TASK [reproducer : Create bundle for CRC] ************************************** Thursday 09 October 2025 21:06:50 +0000 (0:00:00.045) 0:03:03.054 ****** skipping: [instance] TASK [reproducer : Install some tools] ***************************************** Thursday 09 October 2025 21:06:50 +0000 (0:00:00.047) 0:03:03.102 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject command aliases for faster debugging] **************** Thursday 09 October 2025 21:06:52 +0000 (0:00:01.273) 0:03:04.376 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Build job inventory for hook usage] ************************* Thursday 09 October 2025 21:06:53 +0000 (0:00:01.191) 0:03:05.568 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Push the MAC mapping data] ********************************** Thursday 09 October 2025 21:06:53 +0000 (0:00:00.737) 0:03:06.305 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject other Hypervisor SSH keys] *************************** Thursday 09 October 2025 21:06:55 +0000 (0:00:01.078) 0:03:07.383 ****** changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** Thursday 09 October 2025 21:06:56 +0000 (0:00:01.221) 0:03:08.604 ****** changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject SSH configuration] *********************************** Thursday 09 October 2025 21:06:57 +0000 (0:00:00.789) 0:03:09.394 ****** skipping: [instance] => (item=instance) changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) TASK [reproducer : Create kube directory] ************************************** Thursday 09 October 2025 21:06:58 +0000 (0:00:01.922) 0:03:11.317 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeconfig content] ********************************** Thursday 09 October 2025 21:06:59 +0000 (0:00:00.610) 0:03:11.928 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeadmin-password if exists] ************************ Thursday 09 October 2025 21:07:00 +0000 (0:00:01.012) 0:03:12.940 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject devscripts private key if set] *********************** Thursday 09 October 2025 21:07:01 +0000 (0:00:01.105) 0:03:14.045 ****** skipping: [instance] TASK [reproducer : Ensure /etc/ci/env is created] ****************************** Thursday 09 October 2025 21:07:01 +0000 (0:00:00.043) 0:03:14.088 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Ensure directory tree exist] **************************** Thursday 09 October 2025 21:07:02 +0000 (0:00:00.672) 0:03:14.761 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Assert we get needed data] ****************************** Thursday 09 October 2025 21:07:03 +0000 (0:00:00.683) 0:03:15.445 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Push reproducer secrets] ******************************** Thursday 09 October 2025 21:07:03 +0000 (0:00:00.046) 0:03:15.491 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) TASK [manage_secrets : Debug _secret_dest] ************************************* Thursday 09 October 2025 21:07:03 +0000 (0:00:00.076) 0:03:15.567 ****** ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt TASK [manage_secrets : Debug _secret_file] ************************************* Thursday 09 October 2025 21:07:03 +0000 (0:00:00.061) 0:03:15.629 ****** ok: [instance -> controller-0(controller-0.instance)] => _secret_file: '' TASK [manage_secrets : Debug _secret_content] ********************************** Thursday 09 October 2025 21:07:03 +0000 (0:00:00.062) 0:03:15.691 ****** ok: [instance -> controller-0(controller-0.instance)] => _secret_content: my-default-location-place TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Thursday 09 October 2025 21:07:03 +0000 (0:00:00.058) 0:03:15.749 ****** skipping: [instance] TASK [manage_secrets : Check if pull secret src file exists] ******************* Thursday 09 October 2025 21:07:03 +0000 (0:00:00.053) 0:03:15.803 ****** skipping: [instance] TASK [manage_secrets : Copy file to location] ********************************** Thursday 09 October 2025 21:07:03 +0000 (0:00:00.053) 0:03:15.856 ****** skipping: [instance] TASK [manage_secrets : Create file from content] ******************************* Thursday 09 October 2025 21:07:03 +0000 (0:00:00.054) 0:03:15.911 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Debug _secret_dest] ************************************* Thursday 09 October 2025 21:07:04 +0000 (0:00:01.111) 0:03:17.022 ****** ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ipmi-things TASK [manage_secrets : Debug _secret_file] ************************************* Thursday 09 October 2025 21:07:04 +0000 (0:00:00.061) 0:03:17.084 ****** ok: [instance -> controller-0(controller-0.instance)] => _secret_file: /tmp/ipmi-things TASK [manage_secrets : Debug _secret_content] ********************************** Thursday 09 October 2025 21:07:04 +0000 (0:00:00.055) 0:03:17.140 ****** ok: [instance -> controller-0(controller-0.instance)] => _secret_content: '' TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Thursday 09 October 2025 21:07:04 +0000 (0:00:00.055) 0:03:17.195 ****** ok: [instance -> controller-0(controller-0.instance)] => changed=false msg: All assertions passed TASK [manage_secrets : Check if pull secret src file exists] ******************* Thursday 09 October 2025 21:07:04 +0000 (0:00:00.068) 0:03:17.264 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Copy file to location] ********************************** Thursday 09 October 2025 21:07:05 +0000 (0:00:00.646) 0:03:17.910 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Create file from content] ******************************* Thursday 09 October 2025 21:07:06 +0000 (0:00:01.083) 0:03:18.994 ****** skipping: [instance] TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** Thursday 09 October 2025 21:07:06 +0000 (0:00:00.065) 0:03:19.059 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check if async file is still available] ********************* Thursday 09 October 2025 21:07:07 +0000 (0:00:00.657) 0:03:19.716 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check package install status] ******************************* Thursday 09 October 2025 21:07:08 +0000 (0:00:00.711) 0:03:20.428 ****** FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (89 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (88 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** Thursday 09 October 2025 21:08:21 +0000 (0:01:13.082) 0:04:33.511 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Install required packages] ****************************** Thursday 09 October 2025 21:08:21 +0000 (0:00:00.617) 0:04:34.128 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get ingresses domain] *********************************** Thursday 09 October 2025 21:08:24 +0000 (0:00:02.661) 0:04:36.790 ****** skipping: [instance] TASK [sushy_emulator : Set sushy url for ocp installation] ********************* Thursday 09 October 2025 21:08:24 +0000 (0:00:00.054) 0:04:36.844 ****** skipping: [instance] TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** Thursday 09 October 2025 21:08:24 +0000 (0:00:00.061) 0:04:36.905 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp private ssh key for later use] ******************** Thursday 09 October 2025 21:08:25 +0000 (0:00:00.704) 0:04:37.610 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* Thursday 09 October 2025 21:08:25 +0000 (0:00:00.730) 0:04:38.340 ****** changed: [instance] TASK [sushy_emulator : Run ssh-keyscan] **************************************** Thursday 09 October 2025 21:08:26 +0000 (0:00:00.341) 0:04:38.682 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write known hosts for later use] ************************ Thursday 09 October 2025 21:08:27 +0000 (0:00:00.871) 0:04:39.553 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Thursday 09 October 2025 21:08:28 +0000 (0:00:01.168) 0:04:40.722 ****** skipping: [instance] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Thursday 09 October 2025 21:08:28 +0000 (0:00:00.057) 0:04:40.780 ****** skipping: [instance] TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Thursday 09 October 2025 21:08:28 +0000 (0:00:00.054) 0:04:40.834 ****** skipping: [instance] TASK [sushy_emulator : Generate list of filtered VMs] ************************** Thursday 09 October 2025 21:08:28 +0000 (0:00:00.052) 0:04:40.886 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** Thursday 09 October 2025 21:08:28 +0000 (0:00:00.082) 0:04:40.968 ****** skipping: [instance] TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** Thursday 09 October 2025 21:08:28 +0000 (0:00:00.054) 0:04:41.024 ****** skipping: [instance] TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** Thursday 09 October 2025 21:08:28 +0000 (0:00:00.057) 0:04:41.081 ****** skipping: [instance] TASK [sushy_emulator : Generate htpasswd string] ******************************* Thursday 09 October 2025 21:08:28 +0000 (0:00:00.061) 0:04:41.142 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write sushy emulator resource loop] ********************* Thursday 09 October 2025 21:08:29 +0000 (0:00:00.726) 0:04:41.869 ****** skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=pod) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Write sushy emulator config] **************************** Thursday 09 October 2025 21:08:29 +0000 (0:00:00.114) 0:04:41.983 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write htpasswd string to file] ************************** Thursday 09 October 2025 21:08:30 +0000 (0:00:01.220) 0:04:43.203 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** Thursday 09 October 2025 21:08:32 +0000 (0:00:01.156) 0:04:44.360 ****** skipping: [instance] TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** Thursday 09 October 2025 21:08:32 +0000 (0:00:00.058) 0:04:44.418 ****** skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* Thursday 09 October 2025 21:08:32 +0000 (0:00:00.054) 0:04:44.472 ****** skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** Thursday 09 October 2025 21:08:32 +0000 (0:00:00.089) 0:04:44.561 ****** skipping: [instance] TASK [podman : Ensure podman is installed] ************************************* Thursday 09 October 2025 21:08:32 +0000 (0:00:00.050) 0:04:44.612 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [podman : Enable loginctl linger for ansible_user_id] ********************* Thursday 09 October 2025 21:08:33 +0000 (0:00:01.701) 0:04:46.314 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* Thursday 09 October 2025 21:08:34 +0000 (0:00:00.833) 0:04:47.147 ****** skipping: [instance] TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* Thursday 09 October 2025 21:08:34 +0000 (0:00:00.049) 0:04:47.197 ****** skipping: [instance] TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** Thursday 09 October 2025 21:08:34 +0000 (0:00:00.040) 0:04:47.238 ****** skipping: [instance] TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** Thursday 09 October 2025 21:08:34 +0000 (0:00:00.057) 0:04:47.295 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create and start Sushy Emulator container] ************** Thursday 09 October 2025 21:08:45 +0000 (0:00:10.528) 0:04:57.824 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure directories exist] *********************************** Thursday 09 October 2025 21:08:46 +0000 (0:00:01.514) 0:04:59.338 ****** ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Convert VBMC list into a dict for better usage] ************* Thursday 09 October 2025 21:08:48 +0000 (0:00:01.257) 0:05:00.595 ****** skipping: [instance] TASK [reproducer : Check if baremetal-info.yml exists] ************************* Thursday 09 October 2025 21:08:48 +0000 (0:00:00.048) 0:05:00.644 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get content of baremetal-info file] ************************* Thursday 09 October 2025 21:08:48 +0000 (0:00:00.671) 0:05:01.316 ****** skipping: [instance] TASK [reproducer : Interpret remote file content as yaml] ********************** Thursday 09 October 2025 21:08:49 +0000 (0:00:00.048) 0:05:01.365 ****** skipping: [instance] TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Thursday 09 October 2025 21:08:49 +0000 (0:00:00.068) 0:05:01.433 ****** skipping: [instance] TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Thursday 09 October 2025 21:08:49 +0000 (0:00:00.054) 0:05:01.487 ****** skipping: [instance] TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** Thursday 09 October 2025 21:08:49 +0000 (0:00:00.043) 0:05:01.531 ****** ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '2035c3c3-0793-45a0-9cc9-c0c39cf35f88'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': 'e74368ae-a7f8-4805-a0a1-e563aff68bd3'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': 'c06d5455-8e2a-454b-8092-d1494c796c38'}) TASK [reproducer : Output baremetal info file] ********************************* Thursday 09 October 2025 21:08:49 +0000 (0:00:00.150) 0:05:01.682 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Output ironic_nodes to file] ******************************** Thursday 09 October 2025 21:08:50 +0000 (0:00:01.075) 0:05:02.757 ****** skipping: [instance] TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* Thursday 09 October 2025 21:08:50 +0000 (0:00:00.044) 0:05:02.801 ****** TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** Thursday 09 October 2025 21:08:50 +0000 (0:00:00.157) 0:05:02.959 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Thursday 09 October 2025 21:08:50 +0000 (0:00:00.052) 0:05:03.011 ****** skipping: [instance] TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Thursday 09 October 2025 21:08:50 +0000 (0:00:00.046) 0:05:03.057 ****** skipping: [instance] TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** Thursday 09 October 2025 21:08:50 +0000 (0:00:00.042) 0:05:03.100 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** Thursday 09 October 2025 21:08:52 +0000 (0:00:01.585) 0:05:04.686 ****** ok: [instance -> controller-0(controller-0.instance)] => (item=2035c3c3-0793-45a0-9cc9-c0c39cf35f88) ok: [instance -> controller-0(controller-0.instance)] => (item=e74368ae-a7f8-4805-a0a1-e563aff68bd3) ok: [instance -> controller-0(controller-0.instance)] => (item=c06d5455-8e2a-454b-8092-d1494c796c38) TASK [sushy_emulator : Verify baremetal VM power status] *********************** Thursday 09 October 2025 21:08:57 +0000 (0:00:05.138) 0:05:09.825 ****** ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** Thursday 09 October 2025 21:08:57 +0000 (0:00:00.109) 0:05:09.934 ****** ok: [instance -> localhost] TASK [reproducer : Sync local repositories to other hosts if present] ********** Thursday 09 October 2025 21:08:57 +0000 (0:00:00.236) 0:05:10.171 ****** changed: [instance -> localhost] => (item=controller-0) TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** Thursday 09 October 2025 21:08:59 +0000 (0:00:01.865) 0:05:12.036 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install ansible dependencies] ******************************* Thursday 09 October 2025 21:09:00 +0000 (0:00:00.739) 0:05:12.776 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** Thursday 09 October 2025 21:09:01 +0000 (0:00:00.744) 0:05:13.521 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** Thursday 09 October 2025 21:09:02 +0000 (0:00:01.191) 0:05:14.713 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject local environment parameters] ************************ Thursday 09 October 2025 21:09:03 +0000 (0:00:00.746) 0:05:15.460 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create openshift-environment.yml symlink to old location] *** Thursday 09 October 2025 21:09:04 +0000 (0:00:01.149) 0:05:16.609 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get interfaces-info content] ******************************** Thursday 09 October 2025 21:09:04 +0000 (0:00:00.668) 0:05:17.278 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Wait for OCP nodes to be ready] ***************************** Thursday 09 October 2025 21:09:05 +0000 (0:00:00.674) 0:05:17.952 ****** ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) TASK [networking_mapper : Check for Networking Definition file existence] ****** Thursday 09 October 2025 21:09:07 +0000 (0:00:01.450) 0:05:19.403 ****** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Thursday 09 October 2025 21:09:07 +0000 (0:00:00.044) 0:05:19.447 ****** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Thursday 09 October 2025 21:09:07 +0000 (0:00:00.045) 0:05:19.493 ****** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Thursday 09 October 2025 21:09:07 +0000 (0:00:00.044) 0:05:19.537 ****** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Thursday 09 October 2025 21:09:07 +0000 (0:00:00.044) 0:05:19.582 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Thursday 09 October 2025 21:09:07 +0000 (0:00:00.045) 0:05:19.627 ****** ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) ok: [instance -> controller-0(controller-0.instance)] => (item={}) TASK [networking_mapper : Gather facts if requested] *************************** Thursday 09 October 2025 21:09:07 +0000 (0:00:00.114) 0:05:19.742 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance TASK [networking_mapper : Gather the facts] ************************************ Thursday 09 October 2025 21:09:07 +0000 (0:00:00.059) 0:05:19.801 ****** ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** Thursday 09 October 2025 21:09:11 +0000 (0:00:03.700) 0:05:23.501 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Thursday 09 October 2025 21:09:12 +0000 (0:00:01.109) 0:05:24.611 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Definition to file] ************* Thursday 09 October 2025 21:09:12 +0000 (0:00:00.500) 0:05:25.112 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Call the networking mapper] ************************** Thursday 09 October 2025 21:09:13 +0000 (0:00:00.981) 0:05:26.093 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set networking mapper facts] ************************* Thursday 09 October 2025 21:09:13 +0000 (0:00:00.092) 0:05:26.186 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Thursday 09 October 2025 21:09:13 +0000 (0:00:00.061) 0:05:26.247 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CRC ssh key] ***************************************** Thursday 09 October 2025 21:09:14 +0000 (0:00:01.066) 0:05:27.313 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure we have all dependencies installed] ****************** Thursday 09 October 2025 21:09:15 +0000 (0:00:00.954) 0:05:28.268 ****** FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [Configure ntp service] *************************************************** Thursday 09 October 2025 21:09:22 +0000 (0:00:06.113) 0:05:34.381 ****** TASK [cifmw_ntp : Install chrony] ********************************************** Thursday 09 October 2025 21:09:22 +0000 (0:00:00.233) 0:05:34.615 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Configure original chrony.conf file] ************************* Thursday 09 October 2025 21:09:23 +0000 (0:00:01.026) 0:05:35.641 ****** ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) TASK [cifmw_ntp : Render chrony extra config file] ***************************** Thursday 09 October 2025 21:09:24 +0000 (0:00:01.068) 0:05:36.709 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Enable chrony service] *************************************** Thursday 09 October 2025 21:09:25 +0000 (0:00:01.024) 0:05:37.733 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Configure CRC node if available] **************************** Thursday 09 October 2025 21:09:26 +0000 (0:00:00.732) 0:05:38.466 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance TASK [reproducer : Get the networking-environment-definition from controller-0] *** Thursday 09 October 2025 21:09:26 +0000 (0:00:00.143) 0:05:38.609 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check which dnsmasq config we must edit] ******************** Thursday 09 October 2025 21:09:26 +0000 (0:00:00.539) 0:05:39.148 ****** ok: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Configure local DNS for CRC pod] **************************** Thursday 09 October 2025 21:09:27 +0000 (0:00:00.523) 0:05:39.672 ****** changed: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** Thursday 09 October 2025 21:09:28 +0000 (0:00:00.692) 0:05:40.365 ****** changed: [instance -> crc-0(crc-0.instance)] TASK [Restart DNS in CRC VM] *************************************************** Thursday 09 October 2025 21:09:28 +0000 (0:00:00.529) 0:05:40.894 ****** TASK [openshift_setup : Check which dnsmasq config we must edit] *************** Thursday 09 October 2025 21:09:28 +0000 (0:00:00.053) 0:05:40.947 ****** ok: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Restart dnsmasq service if used] *********************** Thursday 09 October 2025 21:09:29 +0000 (0:00:00.502) 0:05:41.450 ****** changed: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Stop dnsmasq] ****************************************** Thursday 09 October 2025 21:09:29 +0000 (0:00:00.788) 0:05:42.238 ****** skipping: [instance] TASK [openshift_setup : Start dnsmasq] ***************************************** Thursday 09 October 2025 21:09:29 +0000 (0:00:00.043) 0:05:42.282 ****** skipping: [instance] TASK [reproducer : Remove entry from /etc/hosts] ******************************* Thursday 09 October 2025 21:09:29 +0000 (0:00:00.042) 0:05:42.324 ****** changed: [instance] TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** Thursday 09 October 2025 21:09:30 +0000 (0:00:00.266) 0:05:42.590 ****** skipping: [instance] => (item=) TASK [dnsmasq : Assert we have needed address data] **************************** Thursday 09 October 2025 21:09:30 +0000 (0:00:00.078) 0:05:42.669 ****** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Thursday 09 October 2025 21:09:30 +0000 (0:00:00.038) 0:05:42.707 ****** ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Thursday 09 October 2025 21:09:30 +0000 (0:00:00.078) 0:05:42.786 ****** changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ Thursday 09 October 2025 21:09:30 +0000 (0:00:00.291) 0:05:43.077 ****** TASK [dnsmasq : Assert we have needed host record data] ************************ Thursday 09 October 2025 21:09:30 +0000 (0:00:00.051) 0:05:43.129 ****** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Thursday 09 October 2025 21:09:30 +0000 (0:00:00.067) 0:05:43.196 ****** ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Thursday 09 October 2025 21:09:30 +0000 (0:00:00.062) 0:05:43.259 ****** changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [reproducer : Ensure "testing" domain is "local"] ************************* Thursday 09 October 2025 21:09:31 +0000 (0:00:00.280) 0:05:43.540 ****** changed: [instance] TASK [reproducer : Flush handlers] ********************************************* Thursday 09 October 2025 21:09:31 +0000 (0:00:00.436) 0:05:43.976 ****** RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** Thursday 09 October 2025 21:09:31 +0000 (0:00:00.012) 0:05:43.989 ****** changed: [instance -> controller-0(controller-0.instance)] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Thursday 09 October 2025 21:09:32 +0000 (0:00:00.822) 0:05:44.811 ****** changed: [instance] TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** Thursday 09 October 2025 21:09:32 +0000 (0:00:00.408) 0:05:45.220 ****** skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** Thursday 09 October 2025 21:09:33 +0000 (0:00:00.180) 0:05:45.400 ****** changed: [instance -> compute-0(compute-0.instance)] TASK [reproducer : Tweak dnf configuration] ************************************ Thursday 09 October 2025 21:09:34 +0000 (0:00:01.543) 0:05:46.944 ****** skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Thursday 09 October 2025 21:09:34 +0000 (0:00:00.023) 0:05:46.967 ****** ok: [instance -> compute-0(compute-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Thursday 09 October 2025 21:09:35 +0000 (0:00:00.554) 0:05:47.522 ****** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Thursday 09 October 2025 21:09:35 +0000 (0:00:00.043) 0:05:47.566 ****** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Thursday 09 October 2025 21:09:35 +0000 (0:00:00.043) 0:05:47.609 ****** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Thursday 09 October 2025 21:09:35 +0000 (0:00:00.042) 0:05:47.651 ****** changed: [instance -> compute-0(compute-0.instance)] TASK [reproducer : Get rhos-release and setup repos] *************************** Thursday 09 October 2025 21:09:36 +0000 (0:00:01.453) 0:05:49.105 ****** skipping: [instance] TASK [reproducer : Create repositories on computes] **************************** Thursday 09 October 2025 21:09:36 +0000 (0:00:00.041) 0:05:49.146 ****** skipping: [instance] TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* Thursday 09 October 2025 21:09:36 +0000 (0:00:00.022) 0:05:49.168 ****** skipping: [instance] TASK [reproducer : Push local code] ******************************************** Thursday 09 October 2025 21:09:36 +0000 (0:00:00.034) 0:05:49.202 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance TASK [reproducer : Check if repository directories already exist] ************** Thursday 09 October 2025 21:09:36 +0000 (0:00:00.102) 0:05:49.305 ****** skipping: [instance] TASK [reproducer : Ensure we are not in the job_id branch] ********************* Thursday 09 October 2025 21:09:37 +0000 (0:00:00.045) 0:05:49.350 ****** skipping: [instance] TASK [reproducer : Fetch zuul.items repositories] ****************************** Thursday 09 October 2025 21:09:37 +0000 (0:00:00.046) 0:05:49.397 ****** skipping: [instance] TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** Thursday 09 October 2025 21:09:37 +0000 (0:00:00.053) 0:05:49.450 ****** skipping: [instance] TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** Thursday 09 October 2025 21:09:37 +0000 (0:00:00.049) 0:05:49.500 ****** skipping: [instance] TASK [reproducer : Create target directories beforehand] *********************** Thursday 09 October 2025 21:09:37 +0000 (0:00:00.046) 0:05:49.547 ****** ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) TASK [reproducer : Sync local repositories to ansible controller] ************** Thursday 09 October 2025 21:09:37 +0000 (0:00:00.529) 0:05:50.076 ****** ok: [instance -> localhost] => (item=ci-framework) TASK [reproducer : Sync remote repositories] *********************************** Thursday 09 October 2025 21:09:38 +0000 (0:00:00.631) 0:05:50.708 ****** skipping: [instance] => (item=ci-framework) skipping: [instance] TASK [reproducer : Ensure default repositories are present] ******************** Thursday 09 October 2025 21:09:38 +0000 (0:00:00.048) 0:05:50.756 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) TASK [reproducer : Check repository availability: ci-framework] **************** Thursday 09 October 2025 21:09:38 +0000 (0:00:00.085) 0:05:50.842 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: ci-framework] ******************* Thursday 09 October 2025 21:09:39 +0000 (0:00:00.546) 0:05:51.389 ****** skipping: [instance] TASK [reproducer : Check repository availability: install_yamls] *************** Thursday 09 October 2025 21:09:39 +0000 (0:00:00.044) 0:05:51.433 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: install_yamls] ****************** Thursday 09 October 2025 21:09:39 +0000 (0:00:00.561) 0:05:51.994 ****** skipping: [instance] TASK [reproducer : Check repository availability: architecture] **************** Thursday 09 October 2025 21:09:39 +0000 (0:00:00.056) 0:05:52.050 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: architecture] ******************* Thursday 09 October 2025 21:09:40 +0000 (0:00:00.543) 0:05:52.593 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install collections on controller-0] ************************ Thursday 09 October 2025 21:09:42 +0000 (0:00:02.451) 0:05:55.045 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CI Framework motd] *********************************** Thursday 09 October 2025 21:10:03 +0000 (0:00:20.344) 0:06:15.389 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate some logs] ******************************************* Thursday 09 October 2025 21:10:04 +0000 (0:00:01.178) 0:06:16.567 ****** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* Thursday 09 October 2025 21:10:04 +0000 (0:00:00.107) 0:06:16.675 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate log if present] ************************************** Thursday 09 October 2025 21:10:04 +0000 (0:00:00.508) 0:06:17.183 ****** skipping: [instance] TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** Thursday 09 October 2025 21:10:04 +0000 (0:00:00.046) 0:06:17.230 ****** skipping: [instance] TASK [cifmw_setup : Get customized parameters] ********************************* Thursday 09 October 2025 21:10:04 +0000 (0:00:00.052) 0:06:17.282 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Ensure target directory exists] ***************************** Thursday 09 October 2025 21:10:05 +0000 (0:00:00.096) 0:06:17.379 ****** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Thursday 09 October 2025 21:10:05 +0000 (0:00:00.534) 0:06:17.913 ****** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Thursday 09 October 2025 21:10:05 +0000 (0:00:00.047) 0:06:17.960 ****** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Thursday 09 October 2025 21:10:05 +0000 (0:00:00.051) 0:06:18.012 ****** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Thursday 09 October 2025 21:10:05 +0000 (0:00:00.052) 0:06:18.065 ****** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Ensure directories are present] ***************************** Thursday 09 October 2025 21:10:07 +0000 (0:00:01.571) 0:06:19.637 ****** failed: [instance -> controller-0(controller-0.instance)] (item=None) => changed=false censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result' failed: [instance -> controller-0(controller-0.instance)] (item=None) => changed=false censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result' failed: [instance -> controller-0(controller-0.instance)] (item=None) => changed=false censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result' fatal: [instance -> controller-0]: FAILED! => changed=false censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result' TASK [Create dnsmasq dir] ****************************************************** Thursday 09 October 2025 21:10:08 +0000 (0:00:01.608) 0:06:21.245 ****** changed: [instance] TASK [Get journalctl in a file] ************************************************ Thursday 09 October 2025 21:10:09 +0000 (0:00:00.220) 0:06:21.466 ****** changed: [instance] TASK [Dump journalctl output] ************************************************** Thursday 09 October 2025 21:10:09 +0000 (0:00:00.268) 0:06:21.735 ****** changed: [instance] TASK [Copy all dnsmasq config] ************************************************* Thursday 09 October 2025 21:10:09 +0000 (0:00:00.445) 0:06:22.180 ****** changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) TASK [Create log directory] **************************************************** Thursday 09 October 2025 21:10:10 +0000 (0:00:00.550) 0:06:22.730 ****** changed: [instance] TASK [Sync logs from controller-0] ********************************************* Thursday 09 October 2025 21:10:10 +0000 (0:00:00.223) 0:06:22.954 ****** changed: [instance] PLAY RECAP ********************************************************************* instance : ok=489 changed=180 unreachable=0 failed=1 skipped=177 rescued=0 ignored=0 Thursday 09 October 2025 21:10:11 +0000 (0:00:00.952) 0:06:23.906 ****** =============================================================================== reproducer : Check package install status ------------------------------ 73.08s libvirt_manager : Download base image ---------------------------------- 21.14s reproducer : Install collections on controller-0 ----------------------- 20.34s libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.99s libvirt_manager : Install packages required for using KVM -------------- 11.64s sushy_emulator : Pull Sushy Emulator container image ------------------- 10.53s reproducer : Ensure we have all dependencies installed ------------------ 6.11s ci_nmstate : Install required packages on localhost --------------------- 5.15s sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.14s dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.84s networking_mapper : Gather the facts ------------------------------------ 3.70s dnsmasq : Add/Remove address -------------------------------------------- 3.28s sushy_emulator : Install required packages ------------------------------ 2.66s reproducer : Ensure the required parameters are loaded ------------------ 2.63s reproducer : Clone repository if needed: architecture ------------------- 2.45s dnsmasq : Add DHCP entries ---------------------------------------------- 2.19s libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.08s reproducer : Inject SSH configuration ----------------------------------- 1.92s discover_latest_image : Get latest image -------------------------------- 1.88s reproducer : Sync local repositories to other hosts if present ---------- 1.87s