PLAY [Prepare] ***************************************************************** TASK [Gathering Facts] ********************************************************* Monday 24 November 2025 08:40:40 +0000 (0:00:00.019) 0:00:00.019 ******* ok: [instance] TASK [Create custom basedir] *************************************************** Monday 24 November 2025 08:40:41 +0000 (0:00:00.823) 0:00:00.843 ******* changed: [instance] TASK [test_deps : Gather facts if they don't exist] **************************** Monday 24 November 2025 08:40:41 +0000 (0:00:00.305) 0:00:01.148 ******* skipping: [instance] TASK [test_deps : Gather variables for each operating system] ****************** Monday 24 November 2025 08:40:41 +0000 (0:00:00.017) 0:00:01.166 ******* ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) TASK [test_deps : Detect mirrors file] ***************************************** Monday 24 November 2025 08:40:41 +0000 (0:00:00.041) 0:00:01.207 ******* ok: [instance] TASK [test_deps : Disable ubi host subscription-manager integration] *********** Monday 24 November 2025 08:40:41 +0000 (0:00:00.279) 0:00:01.486 ******* ok: [instance] TASK [test_deps : Disable ubi 9 repos] ***************************************** Monday 24 November 2025 08:40:41 +0000 (0:00:00.208) 0:00:01.694 ******* ok: [instance] => (item=ubi-9-appstream) ok: [instance] => (item=ubi-9-baseos) ok: [instance] => (item=ubi-9-codeready-builder) TASK [Deploy repo-setup] ******************************************************* Monday 24 November 2025 08:40:42 +0000 (0:00:00.686) 0:00:02.381 ******* TASK [repo_setup : Ensure directories are present] ***************************** Monday 24 November 2025 08:40:42 +0000 (0:00:00.072) 0:00:02.454 ******* changed: [instance] => (item=tmp) changed: [instance] => (item=artifacts/repositories) changed: [instance] => (item=venv/repo_setup) TASK [repo_setup : Make sure git-core package is installed] ******************** Monday 24 November 2025 08:40:43 +0000 (0:00:00.536) 0:00:02.991 ******* ok: [instance] TASK [repo_setup : Get repo-setup repository] ********************************** Monday 24 November 2025 08:40:43 +0000 (0:00:00.822) 0:00:03.813 ******* changed: [instance] TASK [repo_setup : Initialize python venv and install requirements] ************ Monday 24 November 2025 08:40:45 +0000 (0:00:01.053) 0:00:04.866 ******* changed: [instance] TASK [repo_setup : Install repo-setup package] ********************************* Monday 24 November 2025 08:40:52 +0000 (0:00:07.914) 0:00:12.780 ******* changed: [instance] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Monday 24 November 2025 08:40:53 +0000 (0:00:00.694) 0:00:13.474 ******* skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Monday 24 November 2025 08:40:53 +0000 (0:00:00.021) 0:00:13.496 ******* changed: [instance] TASK [repo_setup : Get component repo] ***************************************** Monday 24 November 2025 08:40:54 +0000 (0:00:00.772) 0:00:14.269 ******* skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Monday 24 November 2025 08:40:54 +0000 (0:00:00.042) 0:00:14.312 ******* skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Monday 24 November 2025 08:40:54 +0000 (0:00:00.037) 0:00:14.349 ******* skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Monday 24 November 2025 08:40:54 +0000 (0:00:00.036) 0:00:14.386 ******* changed: [instance] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Monday 24 November 2025 08:40:55 +0000 (0:00:00.534) 0:00:14.920 ******* changed: [instance] TASK [repo_setup : Dump current-podified hash] ********************************* Monday 24 November 2025 08:40:55 +0000 (0:00:00.463) 0:00:15.384 ******* skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Monday 24 November 2025 08:40:55 +0000 (0:00:00.030) 0:00:15.414 ******* skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Monday 24 November 2025 08:40:55 +0000 (0:00:00.028) 0:00:15.442 ******* skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Monday 24 November 2025 08:40:55 +0000 (0:00:00.040) 0:00:15.483 ******* ok: [instance] TASK [repo_setup : Create download directory] ********************************** Monday 24 November 2025 08:40:55 +0000 (0:00:00.047) 0:00:15.531 ******* skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Monday 24 November 2025 08:40:55 +0000 (0:00:00.031) 0:00:15.563 ******* skipping: [instance] TASK [Download the RPM] ******************************************************** Monday 24 November 2025 08:40:55 +0000 (0:00:00.036) 0:00:15.599 ******* skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Monday 24 November 2025 08:40:55 +0000 (0:00:00.037) 0:00:15.636 ******* skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Monday 24 November 2025 08:40:55 +0000 (0:00:00.035) 0:00:15.672 ******* skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Monday 24 November 2025 08:40:55 +0000 (0:00:00.056) 0:00:15.729 ******* skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Monday 24 November 2025 08:40:55 +0000 (0:00:00.032) 0:00:15.762 ******* skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Monday 24 November 2025 08:40:55 +0000 (0:00:00.029) 0:00:15.791 ******* ok: [instance] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Monday 24 November 2025 08:40:56 +0000 (0:00:00.186) 0:00:15.977 ******* changed: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Monday 24 November 2025 08:40:56 +0000 (0:00:00.219) 0:00:16.196 ******* changed: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Monday 24 November 2025 08:40:56 +0000 (0:00:00.238) 0:00:16.435 ******* skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Monday 24 November 2025 08:40:56 +0000 (0:00:00.023) 0:00:16.458 ******* skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Monday 24 November 2025 08:40:56 +0000 (0:00:00.024) 0:00:16.482 ******* skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Monday 24 November 2025 08:40:56 +0000 (0:00:00.021) 0:00:16.504 ******* skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Monday 24 November 2025 08:40:56 +0000 (0:00:00.021) 0:00:16.525 ******* skipping: [instance] TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** Monday 24 November 2025 08:40:56 +0000 (0:00:00.021) 0:00:16.547 ******* skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Monday 24 November 2025 08:40:56 +0000 (0:00:00.021) 0:00:16.568 ******* skipping: [instance] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Monday 24 November 2025 08:40:56 +0000 (0:00:00.017) 0:00:16.586 ******* skipping: [instance] TASK [repo_setup : Cleanup existing metadata] ********************************** Monday 24 November 2025 08:40:56 +0000 (0:00:00.029) 0:00:16.616 ******* skipping: [instance] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Monday 24 November 2025 08:40:56 +0000 (0:00:00.017) 0:00:16.633 ******* skipping: [instance] TASK [test_deps : Look for redhat-release rpm] ********************************* Monday 24 November 2025 08:40:56 +0000 (0:00:00.019) 0:00:16.653 ******* skipping: [instance] TASK [test_deps : Remove redhat-release] *************************************** Monday 24 November 2025 08:40:56 +0000 (0:00:00.028) 0:00:16.682 ******* skipping: [instance] TASK [test_deps : Install centos-stream-release] ******************************* Monday 24 November 2025 08:40:56 +0000 (0:00:00.031) 0:00:16.713 ******* skipping: [instance] TASK [test_deps : Install additional packages] ********************************* Monday 24 November 2025 08:40:56 +0000 (0:00:00.031) 0:00:16.744 ******* skipping: [instance] TASK [test_deps : Install selinux python libs] ********************************* Monday 24 November 2025 08:40:56 +0000 (0:00:00.031) 0:00:16.775 ******* ok: [instance] TASK [test_deps : Install python yaml libs] ************************************ Monday 24 November 2025 08:41:44 +0000 (0:00:47.966) 0:01:04.742 ******* ok: [instance] TASK [test_deps : Install extra packages] ************************************** Monday 24 November 2025 08:41:46 +0000 (0:00:01.220) 0:01:05.962 ******* skipping: [instance] TASK [ci_setup : Gather variables for each operating system] ******************* Monday 24 November 2025 08:41:46 +0000 (0:00:00.031) 0:01:05.993 ******* ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) TASK [ci_setup : List packages to install] ************************************* Monday 24 November 2025 08:41:46 +0000 (0:00:00.040) 0:01:06.034 ******* ok: [instance] => cifmw_ci_setup_packages: - bash-completion - ca-certificates - git-core - make - tar - tmux - python3-pip TASK [ci_setup : Install needed packages] ************************************** Monday 24 November 2025 08:41:46 +0000 (0:00:00.018) 0:01:06.053 ******* changed: [instance] TASK [ci_setup : Gather version of openshift client] *************************** Monday 24 November 2025 08:41:57 +0000 (0:00:10.962) 0:01:17.015 ******* ok: [instance] TASK [ci_setup : Ensure openshift client install path is present] ************** Monday 24 November 2025 08:41:57 +0000 (0:00:00.554) 0:01:17.570 ******* changed: [instance] TASK [ci_setup : Install openshift client] ************************************* Monday 24 November 2025 08:41:57 +0000 (0:00:00.204) 0:01:17.774 ******* changed: [instance] TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** Monday 24 November 2025 08:42:03 +0000 (0:00:05.936) 0:01:23.710 ******* ok: [instance] TASK [ci_setup : Create completion file] *************************************** Monday 24 November 2025 08:42:03 +0000 (0:00:00.036) 0:01:23.746 ******* changed: [instance] TASK [ci_setup : Source completion from within .bashrc] ************************ Monday 24 November 2025 08:42:04 +0000 (0:00:00.263) 0:01:24.010 ******* changed: [instance] TASK [ci_setup : Check rhsm status] ******************************************** Monday 24 November 2025 08:42:04 +0000 (0:00:00.253) 0:01:24.264 ******* skipping: [instance] TASK [ci_setup : Gather the repos to be enabled] ******************************* Monday 24 November 2025 08:42:04 +0000 (0:00:00.016) 0:01:24.281 ******* skipping: [instance] TASK [ci_setup : Enabling the required repositories.] ************************** Monday 24 November 2025 08:42:04 +0000 (0:00:00.014) 0:01:24.295 ******* skipping: [instance] TASK [ci_setup : Get current /etc/redhat-release] ****************************** Monday 24 November 2025 08:42:04 +0000 (0:00:00.014) 0:01:24.310 ******* skipping: [instance] TASK [ci_setup : Print current /etc/redhat-release] **************************** Monday 24 November 2025 08:42:04 +0000 (0:00:00.015) 0:01:24.326 ******* skipping: [instance] TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* Monday 24 November 2025 08:42:04 +0000 (0:00:00.015) 0:01:24.342 ******* skipping: [instance] TASK [ci_setup : Manage directories] ******************************************* Monday 24 November 2025 08:42:04 +0000 (0:00:00.020) 0:01:24.363 ******* changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) changed: [instance] => (item=/opt/basedir/logs) ok: [instance] => (item=/opt/basedir/tmp) changed: [instance] => (item=/opt/basedir/volumes) changed: [instance] => (item=/opt/basedir/artifacts/parameters) TASK [Create secret file] ****************************************************** Monday 24 November 2025 08:42:05 +0000 (0:00:00.948) 0:01:25.311 ******* changed: [instance] PLAY RECAP ********************************************************************* instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 Monday 24 November 2025 08:42:05 +0000 (0:00:00.328) 0:01:25.640 ******* =============================================================================== test_deps : Install selinux python libs -------------------------------- 47.97s ci_setup : Install needed packages ------------------------------------- 10.96s repo_setup : Initialize python venv and install requirements ------------ 7.91s ci_setup : Install openshift client ------------------------------------- 5.94s test_deps : Install python yaml libs ------------------------------------ 1.22s repo_setup : Get repo-setup repository ---------------------------------- 1.05s ci_setup : Manage directories ------------------------------------------- 0.95s Gathering Facts --------------------------------------------------------- 0.82s repo_setup : Make sure git-core package is installed -------------------- 0.82s repo_setup : Run repo-setup --------------------------------------------- 0.77s repo_setup : Install repo-setup package --------------------------------- 0.69s test_deps : Disable ubi 9 repos ----------------------------------------- 0.69s ci_setup : Gather version of openshift client --------------------------- 0.55s repo_setup : Ensure directories are present ----------------------------- 0.54s repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.46s Create secret file ------------------------------------------------------ 0.33s Create custom basedir --------------------------------------------------- 0.31s test_deps : Detect mirrors file ----------------------------------------- 0.28s ci_setup : Create completion file --------------------------------------- 0.26s PLAY [Converge] **************************************************************** TASK [Gathering Facts] ********************************************************* Monday 24 November 2025 08:42:06 +0000 (0:00:00.026) 0:00:00.026 ******* ok: [instance] TASK [Load networking definition from scenario file] *************************** Monday 24 November 2025 08:42:07 +0000 (0:00:00.800) 0:00:00.827 ******* ok: [instance] TASK [discover_latest_image : Get latest image] ******************************** Monday 24 November 2025 08:42:07 +0000 (0:00:00.022) 0:00:00.850 ******* changed: [instance] TASK [discover_latest_image : Export facts accordingly] ************************ Monday 24 November 2025 08:42:08 +0000 (0:00:01.581) 0:00:02.431 ******* ok: [instance] TASK [reproducer : Load CI job environment] ************************************ Monday 24 November 2025 08:42:08 +0000 (0:00:00.026) 0:00:02.458 ******* skipping: [instance] TASK [Build final libvirt layout] ********************************************** Monday 24 November 2025 08:42:08 +0000 (0:00:00.021) 0:00:02.479 ******* TASK [libvirt_manager : Chose right parameter for layout definition] *********** Monday 24 November 2025 08:42:08 +0000 (0:00:00.070) 0:00:02.550 ******* ok: [instance] TASK [libvirt_manager : Patch the layout if needed] **************************** Monday 24 November 2025 08:42:09 +0000 (0:00:00.081) 0:00:02.631 ******* skipping: [instance] TASK [reproducer : Assert no conflicting parameters were passed] *************** Monday 24 November 2025 08:42:09 +0000 (0:00:00.060) 0:00:02.691 ******* ok: [instance] TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** Monday 24 November 2025 08:42:09 +0000 (0:00:00.027) 0:00:02.719 ******* ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Set _use_crc based on actual layout] ************************ Monday 24 November 2025 08:42:09 +0000 (0:00:00.023) 0:00:02.742 ******* ok: [instance] TASK [reproducer : Ensure directories are present] ***************************** Monday 24 November 2025 08:42:09 +0000 (0:00:00.041) 0:00:02.784 ******* ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [Bootstrap libvirt if needed] ********************************************* Monday 24 November 2025 08:42:09 +0000 (0:00:00.432) 0:00:03.216 ******* TASK [libvirt_manager : Ensure output directory exists] ************************ Monday 24 November 2025 08:42:09 +0000 (0:00:00.075) 0:00:03.292 ******* ok: [instance] TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* Monday 24 November 2025 08:42:09 +0000 (0:00:00.182) 0:00:03.474 ******* changed: [instance] TASK [libvirt_manager : Check if KVM is enabled] ******************************* Monday 24 November 2025 08:42:10 +0000 (0:00:00.267) 0:00:03.742 ******* ok: [instance] TASK [libvirt_manager : Fail if KVM not enabled] ******************************* Monday 24 November 2025 08:42:10 +0000 (0:00:00.290) 0:00:04.032 ******* skipping: [instance] TASK [libvirt_manager : Check if VMX virtualization] *************************** Monday 24 November 2025 08:42:10 +0000 (0:00:00.028) 0:00:04.060 ******* skipping: [instance] TASK [libvirt_manager : Check if SVM virtualization] *************************** Monday 24 November 2025 08:42:10 +0000 (0:00:00.017) 0:00:04.077 ******* ok: [instance] TASK [libvirt_manager : Enable VMX virtualization] ***************************** Monday 24 November 2025 08:42:10 +0000 (0:00:00.020) 0:00:04.098 ******* skipping: [instance] TASK [libvirt_manager : Install packages required for using KVM] *************** Monday 24 November 2025 08:42:10 +0000 (0:00:00.028) 0:00:04.127 ******* changed: [instance] TASK [libvirt_manager : Create rules.d polkit folder] ************************** Monday 24 November 2025 08:42:26 +0000 (0:00:16.201) 0:00:20.328 ******* changed: [instance] TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* Monday 24 November 2025 08:42:27 +0000 (0:00:00.247) 0:00:20.576 ******* changed: [instance] TASK [libvirt_manager : Restart service polkit service] ************************ Monday 24 November 2025 08:42:27 +0000 (0:00:00.481) 0:00:21.058 ******* changed: [instance] TASK [libvirt_manager : Remove directory for service override] ***************** Monday 24 November 2025 08:42:28 +0000 (0:00:00.585) 0:00:21.643 ******* ok: [instance] TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** Monday 24 November 2025 08:42:28 +0000 (0:00:00.191) 0:00:21.835 ******* ok: [instance] TASK [libvirt_manager : Ensure firewalld service is up] ************************ Monday 24 November 2025 08:42:28 +0000 (0:00:00.655) 0:00:22.491 ******* changed: [instance] TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** Monday 24 November 2025 08:42:29 +0000 (0:00:00.884) 0:00:23.375 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* Monday 24 November 2025 08:42:29 +0000 (0:00:00.084) 0:00:23.460 ******* ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** Monday 24 November 2025 08:42:30 +0000 (0:00:00.322) 0:00:23.783 ******* ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** Monday 24 November 2025 08:42:30 +0000 (0:00:00.323) 0:00:24.106 ******* ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** Monday 24 November 2025 08:42:30 +0000 (0:00:00.321) 0:00:24.428 ******* ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** Monday 24 November 2025 08:42:32 +0000 (0:00:01.322) 0:00:25.751 ******* ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* Monday 24 November 2025 08:42:32 +0000 (0:00:00.317) 0:00:26.069 ******* ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** Monday 24 November 2025 08:42:32 +0000 (0:00:00.326) 0:00:26.396 ******* ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* Monday 24 November 2025 08:42:33 +0000 (0:00:00.329) 0:00:26.725 ******* ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** Monday 24 November 2025 08:42:33 +0000 (0:00:00.322) 0:00:27.047 ******* ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** Monday 24 November 2025 08:42:33 +0000 (0:00:00.319) 0:00:27.366 ******* ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* Monday 24 November 2025 08:42:34 +0000 (0:00:00.319) 0:00:27.686 ******* ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** Monday 24 November 2025 08:42:34 +0000 (0:00:00.321) 0:00:28.007 ******* ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** Monday 24 November 2025 08:42:34 +0000 (0:00:00.319) 0:00:28.326 ******* ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** Monday 24 November 2025 08:42:35 +0000 (0:00:00.321) 0:00:28.648 ******* ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** Monday 24 November 2025 08:42:35 +0000 (0:00:00.356) 0:00:29.004 ******* ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* Monday 24 November 2025 08:42:35 +0000 (0:00:00.321) 0:00:29.326 ******* ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** Monday 24 November 2025 08:42:36 +0000 (0:00:00.337) 0:00:29.664 ******* ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ Monday 24 November 2025 08:42:36 +0000 (0:00:00.341) 0:00:30.005 ******* ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** Monday 24 November 2025 08:42:36 +0000 (0:00:00.340) 0:00:30.345 ******* ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* Monday 24 November 2025 08:42:37 +0000 (0:00:00.336) 0:00:30.681 ******* ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** Monday 24 November 2025 08:42:37 +0000 (0:00:00.336) 0:00:31.018 ******* ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** Monday 24 November 2025 08:42:37 +0000 (0:00:00.334) 0:00:31.352 ******* ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* Monday 24 November 2025 08:42:38 +0000 (0:00:00.339) 0:00:31.692 ******* ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* Monday 24 November 2025 08:42:38 +0000 (0:00:00.352) 0:00:32.044 ******* ok: [instance] TASK [libvirt_manager : Manage service for older releases] ********************* Monday 24 November 2025 08:42:38 +0000 (0:00:00.346) 0:00:32.391 ******* skipping: [instance] TASK [libvirt_manager : Get libvirt group users] ******************************* Monday 24 November 2025 08:42:38 +0000 (0:00:00.026) 0:00:32.418 ******* ok: [instance] TASK [libvirt_manager : Add user if not exists in libvirt group] *************** Monday 24 November 2025 08:42:39 +0000 (0:00:00.295) 0:00:32.713 ******* ok: [instance] TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** Monday 24 November 2025 08:42:39 +0000 (0:00:00.402) 0:00:33.116 ******* changed: [instance] TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* Monday 24 November 2025 08:42:39 +0000 (0:00:00.329) 0:00:33.446 ******* [WARNING]: Reset is not implemented for this connection changed: [instance] TASK [libvirt_manager : Ensure we reload user env] ***************************** Monday 24 November 2025 08:42:40 +0000 (0:00:00.296) 0:00:33.742 ******* TASK [reproducer : Deploy networks in libvirt] ********************************* Monday 24 November 2025 08:42:40 +0000 (0:00:00.015) 0:00:33.758 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance TASK [reproducer : Ensure networks are consistent] ***************************** Monday 24 November 2025 08:42:40 +0000 (0:00:00.110) 0:00:33.868 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Monday 24 November 2025 08:42:40 +0000 (0:00:00.047) 0:00:33.916 ******* ok: [instance] => (item=compute) ok: [instance] => (item=controller) ok: [instance] => (item=crc) TASK [reproducer : Ensure all standard attached networks are defined] ********** Monday 24 November 2025 08:42:40 +0000 (0:00:00.087) 0:00:34.004 ******* ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Monday 24 November 2025 08:42:40 +0000 (0:00:00.045) 0:00:34.049 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Ensure we get latest OCP config] ***************************************** Monday 24 November 2025 08:42:40 +0000 (0:00:00.047) 0:00:34.096 ******* TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** Monday 24 November 2025 08:42:40 +0000 (0:00:00.050) 0:00:34.146 ******* ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) ok: [instance] => (item={}) TASK [devscripts : Replace OCP version if "stable-" alias used] **************** Monday 24 November 2025 08:42:40 +0000 (0:00:00.078) 0:00:34.225 ******* skipping: [instance] TASK [devscripts : Ensure output directory exists] ***************************** Monday 24 November 2025 08:42:40 +0000 (0:00:00.018) 0:00:34.243 ******* ok: [instance] TASK [devscripts : Output built config for easier debugging] ******************* Monday 24 November 2025 08:42:40 +0000 (0:00:00.234) 0:00:34.478 ******* changed: [instance] TASK [ci_network : Remove the local dns configuration] ************************* Monday 24 November 2025 08:42:41 +0000 (0:00:00.368) 0:00:34.846 ******* ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) TASK [ci_network : Reload the NetworkManager to pick the changes] ************** Monday 24 November 2025 08:42:42 +0000 (0:00:00.798) 0:00:35.644 ******* skipping: [instance] TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* Monday 24 November 2025 08:42:42 +0000 (0:00:00.029) 0:00:35.674 ******* changed: [instance] TASK [reproducer : Flush handlers for NetworkManager restart] ****************** Monday 24 November 2025 08:42:42 +0000 (0:00:00.384) 0:00:36.058 ******* RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Monday 24 November 2025 08:42:42 +0000 (0:00:00.008) 0:00:36.067 ******* changed: [instance] TASK [Ensure no default networks exists] *************************************** Monday 24 November 2025 08:42:42 +0000 (0:00:00.453) 0:00:36.520 ******* TASK [libvirt_manager : Deactivate crc] **************************************** Monday 24 November 2025 08:42:43 +0000 (0:00:00.072) 0:00:36.593 ******* ok: [instance] TASK [libvirt_manager : Removing crc] ****************************************** Monday 24 November 2025 08:42:44 +0000 (0:00:01.248) 0:00:37.842 ******* ok: [instance] TASK [libvirt_manager : Deactivate default] ************************************ Monday 24 November 2025 08:42:44 +0000 (0:00:00.243) 0:00:38.085 ******* ok: [instance] TASK [libvirt_manager : Removing default] ************************************** Monday 24 November 2025 08:42:45 +0000 (0:00:00.575) 0:00:38.660 ******* ok: [instance] TASK [reproducer : Ensure firewalld is installed] ****************************** Monday 24 November 2025 08:42:45 +0000 (0:00:00.239) 0:00:38.899 ******* ok: [instance] TASK [reproducer : Ensure firewalld service is enabled and started] ************ Monday 24 November 2025 08:42:46 +0000 (0:00:01.259) 0:00:40.159 ******* ok: [instance] TASK [reproducer : Ensure br_netfilter module is loaded] *********************** Monday 24 November 2025 08:42:46 +0000 (0:00:00.324) 0:00:40.484 ******* changed: [instance] TASK [reproducer : Ensure IP forwarding is enabled] **************************** Monday 24 November 2025 08:42:47 +0000 (0:00:00.324) 0:00:40.809 ******* changed: [instance] TASK [reproducer : Ensure the required parameters are loaded] ****************** Monday 24 November 2025 08:42:47 +0000 (0:00:00.317) 0:00:41.126 ******* changed: [instance] => (item=arptables) changed: [instance] => (item=iptables) changed: [instance] => (item=ip6tables) TASK [reproducer : Ensure firewall service is enabled and started] ************* Monday 24 November 2025 08:42:48 +0000 (0:00:00.591) 0:00:41.718 ******* ok: [instance] TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* Monday 24 November 2025 08:42:48 +0000 (0:00:00.322) 0:00:42.041 ******* ok: [instance] TASK [Ensure the required network configurations are applied] ****************** Monday 24 November 2025 08:42:48 +0000 (0:00:00.093) 0:00:42.134 ******* TASK [networking_mapper : Check for Networking Environment Definition file existence] *** Monday 24 November 2025 08:42:48 +0000 (0:00:00.044) 0:00:42.179 ******* skipping: [instance] TASK [networking_mapper : Check for Networking Definition file existance] ****** Monday 24 November 2025 08:42:48 +0000 (0:00:00.023) 0:00:42.203 ******* skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Monday 24 November 2025 08:42:48 +0000 (0:00:00.023) 0:00:42.226 ******* skipping: [instance] TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** Monday 24 November 2025 08:42:48 +0000 (0:00:00.023) 0:00:42.250 ******* skipping: [instance] TASK [ci_nmstate : Initialize NMstates for each instance] ********************** Monday 24 November 2025 08:42:48 +0000 (0:00:00.028) 0:00:42.278 ******* ok: [instance] TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** Monday 24 November 2025 08:42:48 +0000 (0:00:00.041) 0:00:42.319 ******* skipping: [instance] TASK [ci_nmstate : Get k8s nodes] ********************************************** Monday 24 November 2025 08:42:48 +0000 (0:00:00.035) 0:00:42.355 ******* skipping: [instance] TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** Monday 24 November 2025 08:42:48 +0000 (0:00:00.023) 0:00:42.378 ******* ok: [instance] TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* Monday 24 November 2025 08:42:48 +0000 (0:00:00.058) 0:00:42.437 ******* skipping: [instance] TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* Monday 24 November 2025 08:42:48 +0000 (0:00:00.023) 0:00:42.460 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) TASK [ci_nmstate : Ensure we have needed facts] ******************************** Monday 24 November 2025 08:42:48 +0000 (0:00:00.048) 0:00:42.508 ******* ok: [instance -> localhost] TASK [ci_nmstate : Install required packages on localhost] ********************* Monday 24 November 2025 08:42:49 +0000 (0:00:00.322) 0:00:42.830 ******* changed: [instance -> localhost] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Monday 24 November 2025 08:42:56 +0000 (0:00:07.667) 0:00:50.497 ******* changed: [instance] TASK [ci_nmstate : Save nmstate state for localhost] *************************** Monday 24 November 2025 08:42:57 +0000 (0:00:00.187) 0:00:50.685 ******* changed: [instance] TASK [ci_nmstate : Apply the desidered state on localhost] ********************* Monday 24 November 2025 08:42:57 +0000 (0:00:00.342) 0:00:51.028 ******* changed: [instance -> localhost] TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** Monday 24 November 2025 08:42:59 +0000 (0:00:01.603) 0:00:52.631 ******* changed: [instance] TASK [reproducer : Select right domain] **************************************** Monday 24 November 2025 08:42:59 +0000 (0:00:00.341) 0:00:52.973 ******* ok: [instance] TASK [Create the virtual networks] ********************************************* Monday 24 November 2025 08:42:59 +0000 (0:00:00.028) 0:00:53.002 ******* TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** Monday 24 November 2025 08:42:59 +0000 (0:00:00.112) 0:00:53.115 ******* ok: [instance] TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* Monday 24 November 2025 08:42:59 +0000 (0:00:00.017) 0:00:53.132 ******* ok: [instance] TASK [libvirt_manager : Load file if exists] *********************************** Monday 24 November 2025 08:42:59 +0000 (0:00:00.185) 0:00:53.318 ******* skipping: [instance] TASK [libvirt_manager : Update fact with existing content] ********************* Monday 24 November 2025 08:42:59 +0000 (0:00:00.027) 0:00:53.345 ******* skipping: [instance] TASK [libvirt_manager : Generate VM list] ************************************** Monday 24 November 2025 08:42:59 +0000 (0:00:00.027) 0:00:53.373 ******* ok: [instance] TASK [libvirt_manager : Generate/update mapping all nodes] ********************* Monday 24 November 2025 08:42:59 +0000 (0:00:00.054) 0:00:53.428 ******* ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Append baremetal nodes if needed] ********************** Monday 24 November 2025 08:42:59 +0000 (0:00:00.128) 0:00:53.556 ******* skipping: [instance] TASK [libvirt_manager : Dump MAC mapping] ************************************** Monday 24 November 2025 08:43:00 +0000 (0:00:00.033) 0:00:53.589 ******* changed: [instance] TASK [libvirt_manager : Inject all VMs in the inventory] *********************** Monday 24 November 2025 08:43:00 +0000 (0:00:00.338) 0:00:53.928 ******* changed: [instance] => (item=Adding compute-0 to computes) changed: [instance] => (item=Adding controller-0 to controllers) changed: [instance] => (item=Adding crc-0 to ocps) TASK [networking_mapper : Check for Networking Definition file existence] ****** Monday 24 November 2025 08:43:00 +0000 (0:00:00.116) 0:00:54.044 ******* skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Monday 24 November 2025 08:43:00 +0000 (0:00:00.021) 0:00:54.066 ******* skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Monday 24 November 2025 08:43:00 +0000 (0:00:00.022) 0:00:54.088 ******* skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Monday 24 November 2025 08:43:00 +0000 (0:00:00.022) 0:00:54.111 ******* skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Monday 24 November 2025 08:43:00 +0000 (0:00:00.023) 0:00:54.134 ******* ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Monday 24 November 2025 08:43:00 +0000 (0:00:00.017) 0:00:54.152 ******* ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Monday 24 November 2025 08:43:00 +0000 (0:00:00.076) 0:00:54.228 ******* skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Monday 24 November 2025 08:43:00 +0000 (0:00:00.016) 0:00:54.244 ******* changed: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Monday 24 November 2025 08:43:00 +0000 (0:00:00.207) 0:00:54.452 ******* changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Monday 24 November 2025 08:43:01 +0000 (0:00:00.394) 0:00:54.847 ******* ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Monday 24 November 2025 08:43:01 +0000 (0:00:00.061) 0:00:54.908 ******* ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Monday 24 November 2025 08:43:01 +0000 (0:00:00.030) 0:00:54.938 ******* changed: [instance] TASK [libvirt_manager : Manage networks if needed] ***************************** Monday 24 November 2025 08:43:01 +0000 (0:00:00.380) 0:00:55.319 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** Monday 24 November 2025 08:43:01 +0000 (0:00:00.078) 0:00:55.397 ******* ok: [instance] => (item=public) ok: [instance] => (item=osp_trunk) TASK [libvirt_manager : Ensure networks are defined] *************************** Monday 24 November 2025 08:43:01 +0000 (0:00:00.049) 0:00:55.447 ******* changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are created/started] ******************* Monday 24 November 2025 08:43:02 +0000 (0:00:00.428) 0:00:55.875 ******* ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are active] **************************** Monday 24 November 2025 08:43:02 +0000 (0:00:00.582) 0:00:56.458 ******* ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** Monday 24 November 2025 08:43:03 +0000 (0:00:00.439) 0:00:56.897 ******* changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** Monday 24 November 2025 08:43:03 +0000 (0:00:00.436) 0:00:57.334 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance TASK [libvirt_manager : Fetch present bridge interfaces] *********************** Monday 24 November 2025 08:43:03 +0000 (0:00:00.059) 0:00:57.394 ******* ok: [instance] TASK [libvirt_manager : Fetch bridges ports link info] ************************* Monday 24 November 2025 08:43:04 +0000 (0:00:00.183) 0:00:57.578 ******* ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [Create dummy interfaces to ensure bridges are UP] ************************ Monday 24 November 2025 08:43:04 +0000 (0:00:00.379) 0:00:57.958 ******* TASK [ci_nmstate : Ensure we have needed facts] ******************************** Monday 24 November 2025 08:43:04 +0000 (0:00:00.068) 0:00:58.027 ******* skipping: [instance] TASK [ci_nmstate : Install required packages on instance] ********************** Monday 24 November 2025 08:43:04 +0000 (0:00:00.036) 0:00:58.063 ******* ok: [instance] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Monday 24 November 2025 08:43:05 +0000 (0:00:01.288) 0:00:59.351 ******* ok: [instance] TASK [ci_nmstate : Save nmstate state for instance] **************************** Monday 24 November 2025 08:43:05 +0000 (0:00:00.187) 0:00:59.539 ******* changed: [instance] TASK [ci_nmstate : Apply the desidered state on instance] ********************** Monday 24 November 2025 08:43:06 +0000 (0:00:00.358) 0:00:59.898 ******* changed: [instance] TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* Monday 24 November 2025 08:43:07 +0000 (0:00:01.649) 0:01:01.547 ******* changed: [instance] TASK [Create extra network configuration] ************************************** Monday 24 November 2025 08:43:08 +0000 (0:00:00.372) 0:01:01.919 ******* skipping: [instance] TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** Monday 24 November 2025 08:43:08 +0000 (0:00:00.035) 0:01:01.955 ******* skipping: [instance] TASK [libvirt_manager : Refresh networking facts on host] ********************** Monday 24 November 2025 08:43:08 +0000 (0:00:00.030) 0:01:01.985 ******* ok: [instance] TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** Monday 24 November 2025 08:43:08 +0000 (0:00:00.442) 0:01:02.427 ******* ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [dnsmasq : Install needed packages] *************************************** Monday 24 November 2025 08:43:09 +0000 (0:00:00.150) 0:01:02.578 ******* ok: [instance] TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** Monday 24 November 2025 08:43:10 +0000 (0:00:01.247) 0:01:03.825 ******* changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) TASK [dnsmasq : Manage configuration directory] ******************************** Monday 24 November 2025 08:43:13 +0000 (0:00:03.733) 0:01:07.558 ******* changed: [instance] TASK [dnsmasq : Manage systemd unit file] ************************************** Monday 24 November 2025 08:43:14 +0000 (0:00:00.226) 0:01:07.784 ******* changed: [instance] TASK [dnsmasq : Manage base configuration file] ******************************** Monday 24 November 2025 08:43:14 +0000 (0:00:00.366) 0:01:08.151 ******* changed: [instance] TASK [dnsmasq : Render listener configuration] ********************************* Monday 24 November 2025 08:43:14 +0000 (0:00:00.393) 0:01:08.545 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance TASK [dnsmasq : Create listener configuration file] **************************** Monday 24 November 2025 08:43:15 +0000 (0:00:00.032) 0:01:08.577 ******* changed: [instance] TASK [dnsmasq : Remove listener configuration file] **************************** Monday 24 November 2025 08:43:15 +0000 (0:00:00.392) 0:01:08.969 ******* skipping: [instance] TASK [dnsmasq : Render dns configuration] ************************************** Monday 24 November 2025 08:43:15 +0000 (0:00:00.020) 0:01:08.989 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance TASK [dnsmasq : Create dns configuration file] ********************************* Monday 24 November 2025 08:43:15 +0000 (0:00:00.034) 0:01:09.024 ******* changed: [instance] TASK [dnsmasq : Remove dns configuration file] ********************************* Monday 24 November 2025 08:43:15 +0000 (0:00:00.379) 0:01:09.404 ******* skipping: [instance] TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** Monday 24 November 2025 08:43:15 +0000 (0:00:00.019) 0:01:09.423 ******* ok: [instance] => (item=127.0.0.2) TASK [dnsmasq : Enable and start service] ************************************** Monday 24 November 2025 08:43:16 +0000 (0:00:00.216) 0:01:09.640 ******* changed: [instance] TASK [dnsmasq : Stop service] ************************************************** Monday 24 November 2025 08:43:16 +0000 (0:00:00.683) 0:01:10.323 ******* skipping: [instance] TASK [dnsmasq : Remove unit file] ********************************************** Monday 24 November 2025 08:43:16 +0000 (0:00:00.020) 0:01:10.343 ******* skipping: [instance] TASK [dnsmasq : Remove main configuration files] ******************************* Monday 24 November 2025 08:43:16 +0000 (0:00:00.019) 0:01:10.363 ******* skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) skipping: [instance] TASK [Create dnsmasq networks] ************************************************* Monday 24 November 2025 08:43:16 +0000 (0:00:00.029) 0:01:10.393 ******* TASK [dnsmasq : Assert mandatory parameter] ************************************ Monday 24 November 2025 08:43:16 +0000 (0:00:00.117) 0:01:10.511 ******* ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Monday 24 November 2025 08:43:16 +0000 (0:00:00.030) 0:01:10.541 ******* ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Monday 24 November 2025 08:43:17 +0000 (0:00:00.038) 0:01:10.579 ******* changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Monday 24 November 2025 08:43:17 +0000 (0:00:00.476) 0:01:11.056 ******* skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Monday 24 November 2025 08:43:17 +0000 (0:00:00.019) 0:01:11.076 ******* skipping: [instance] TASK [dnsmasq : Assert mandatory parameter] ************************************ Monday 24 November 2025 08:43:17 +0000 (0:00:00.024) 0:01:11.101 ******* ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Monday 24 November 2025 08:43:17 +0000 (0:00:00.030) 0:01:11.131 ******* ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Monday 24 November 2025 08:43:17 +0000 (0:00:00.038) 0:01:11.170 ******* changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Monday 24 November 2025 08:43:18 +0000 (0:00:00.441) 0:01:11.611 ******* skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Monday 24 November 2025 08:43:18 +0000 (0:00:00.019) 0:01:11.631 ******* skipping: [instance] TASK [Deploy radvd for IPv6 router advertisements] ***************************** Monday 24 November 2025 08:43:18 +0000 (0:00:00.025) 0:01:11.656 ******* skipping: [instance] TASK [libvirt_manager : Ensure network is in correct zone] ********************* Monday 24 November 2025 08:43:18 +0000 (0:00:00.031) 0:01:11.687 ******* changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Monday 24 November 2025 08:43:18 +0000 (0:00:00.472) 0:01:12.160 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Monday 24 November 2025 08:43:18 +0000 (0:00:00.035) 0:01:12.195 ******* ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Monday 24 November 2025 08:43:18 +0000 (0:00:00.322) 0:01:12.518 ******* ok: [instance] TASK [libvirt_manager : Extract IP address from network bridges] *************** Monday 24 November 2025 08:43:18 +0000 (0:00:00.035) 0:01:12.553 ******* ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Monday 24 November 2025 08:43:19 +0000 (0:00:00.196) 0:01:12.750 ******* ok: [instance] TASK [libvirt_manager : Output _network_data] ********************************** Monday 24 November 2025 08:43:19 +0000 (0:00:00.035) 0:01:12.785 ******* changed: [instance] TASK [libvirt_manager : Output pub_net] **************************************** Monday 24 November 2025 08:43:19 +0000 (0:00:00.339) 0:01:13.125 ******* changed: [instance] TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** Monday 24 November 2025 08:43:19 +0000 (0:00:00.343) 0:01:13.468 ******* changed: [instance] TASK [libvirt_manager : Expose patch for networking_mapper] ******************** Monday 24 November 2025 08:43:20 +0000 (0:00:00.341) 0:01:13.810 ******* ok: [instance] TASK [libvirt_manager : Save networking_mapper patch] ************************** Monday 24 November 2025 08:43:20 +0000 (0:00:00.097) 0:01:13.908 ******* changed: [instance] TASK [networking_mapper : Check for Networking Definition file existence] ****** Monday 24 November 2025 08:43:20 +0000 (0:00:00.337) 0:01:14.246 ******* skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Monday 24 November 2025 08:43:20 +0000 (0:00:00.024) 0:01:14.271 ******* skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Monday 24 November 2025 08:43:20 +0000 (0:00:00.024) 0:01:14.295 ******* skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Monday 24 November 2025 08:43:20 +0000 (0:00:00.024) 0:01:14.319 ******* skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Monday 24 November 2025 08:43:20 +0000 (0:00:00.024) 0:01:14.343 ******* ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Monday 24 November 2025 08:43:20 +0000 (0:00:00.019) 0:01:14.363 ******* ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Monday 24 November 2025 08:43:20 +0000 (0:00:00.090) 0:01:14.453 ******* skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Monday 24 November 2025 08:43:20 +0000 (0:00:00.019) 0:01:14.472 ******* ok: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Monday 24 November 2025 08:43:21 +0000 (0:00:00.206) 0:01:14.678 ******* changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Monday 24 November 2025 08:43:21 +0000 (0:00:00.396) 0:01:15.075 ******* ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Monday 24 November 2025 08:43:21 +0000 (0:00:00.062) 0:01:15.138 ******* ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Monday 24 November 2025 08:43:21 +0000 (0:00:00.034) 0:01:15.173 ******* changed: [instance] TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** Monday 24 November 2025 08:43:22 +0000 (0:00:00.409) 0:01:15.582 ******* ok: [instance] TASK [libvirt_manager : Unset patch] ******************************************* Monday 24 November 2025 08:43:22 +0000 (0:00:00.029) 0:01:15.611 ******* ok: [instance] TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** Monday 24 November 2025 08:43:22 +0000 (0:00:00.020) 0:01:15.631 ******* ok: [instance] TASK [libvirt_manager : Reserve IPs on networks] ******************************* Monday 24 November 2025 08:43:22 +0000 (0:00:00.019) 0:01:15.651 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 24 November 2025 08:43:22 +0000 (0:00:00.074) 0:01:15.726 ******* ok: [instance] => (item=compute-0 - ctlplane) ok: [instance] => (item=controller-0 - ctlplane) ok: [instance] => (item=crc-0 - ctlplane) TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 24 November 2025 08:43:22 +0000 (0:00:00.140) 0:01:15.867 ******* skipping: [instance] => (item=compute-0 - internalapi) skipping: [instance] => (item=controller-0 - internalapi) skipping: [instance] => (item=crc-0 - internalapi) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 24 November 2025 08:43:22 +0000 (0:00:00.116) 0:01:15.984 ******* skipping: [instance] => (item=compute-0 - storage) skipping: [instance] => (item=controller-0 - storage) skipping: [instance] => (item=crc-0 - storage) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 24 November 2025 08:43:22 +0000 (0:00:00.083) 0:01:16.068 ******* skipping: [instance] => (item=compute-0 - tenant) skipping: [instance] => (item=controller-0 - tenant) skipping: [instance] => (item=crc-0 - tenant) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 24 November 2025 08:43:22 +0000 (0:00:00.084) 0:01:16.152 ******* skipping: [instance] => (item=compute-0 - external) skipping: [instance] => (item=controller-0 - external) skipping: [instance] => (item=crc-0 - external) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 24 November 2025 08:43:22 +0000 (0:00:00.121) 0:01:16.274 ******* skipping: [instance] => (item=compute-0 - storagemgmt) skipping: [instance] => (item=controller-0 - storagemgmt) skipping: [instance] => (item=crc-0 - storagemgmt) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 24 November 2025 08:43:22 +0000 (0:00:00.083) 0:01:16.358 ******* ok: [instance] => (item=compute-0 - public) ok: [instance] => (item=controller-0 - public) ok: [instance] => (item=crc-0 - public) TASK [Inject DHCP entries for net {{ net_name }}] ****************************** Monday 24 November 2025 08:43:22 +0000 (0:00:00.143) 0:01:16.501 ******* TASK [dnsmasq : Ensure we have the right data and type] ************************ Monday 24 November 2025 08:43:23 +0000 (0:00:00.110) 0:01:16.612 ******* ok: [instance] TASK [dnsmasq : Assert we have needed host data] ******************************* Monday 24 November 2025 08:43:23 +0000 (0:00:00.039) 0:01:16.651 ******* ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:d3:a6:9d', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:74:9d:d0', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:b1:5b:24', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:c4:56:fa', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:68:a0:ec', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:7a:e2:40', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) TASK [dnsmasq : Ensure networks exists] **************************************** Monday 24 November 2025 08:43:23 +0000 (0:00:00.101) 0:01:16.752 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) TASK [dnsmasq : Check network file status] ************************************* Monday 24 November 2025 08:43:23 +0000 (0:00:00.051) 0:01:16.804 ******* ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Monday 24 November 2025 08:43:23 +0000 (0:00:00.180) 0:01:16.984 ******* ok: [instance] TASK [dnsmasq : Check network file status] ************************************* Monday 24 November 2025 08:43:23 +0000 (0:00:00.025) 0:01:17.010 ******* ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Monday 24 November 2025 08:43:23 +0000 (0:00:00.183) 0:01:17.194 ******* ok: [instance] TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** Monday 24 November 2025 08:43:23 +0000 (0:00:00.024) 0:01:17.218 ******* ok: [instance] TASK [dnsmasq : Compute entry] ************************************************* Monday 24 November 2025 08:43:23 +0000 (0:00:00.020) 0:01:17.239 ******* ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:d3:a6:9d', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:74:9d:d0', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:b1:5b:24', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:c4:56:fa', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:68:a0:ec', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:7a:e2:40', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) TASK [dnsmasq : Create add/remove sets] **************************************** Monday 24 November 2025 08:43:23 +0000 (0:00:00.181) 0:01:17.421 ******* ok: [instance] TASK [dnsmasq : Add DHCP entries] ********************************************** Monday 24 November 2025 08:43:23 +0000 (0:00:00.038) 0:01:17.459 ******* changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:d3:a6:9d', 'entry': 'set:compute,52:54:00:d3:a6:9d,192.168.140.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:74:9d:d0', 'entry': 'set:controller,52:54:01:74:9d:d0,192.168.140.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:b1:5b:24', 'entry': 'set:ocp,52:54:02:b1:5b:24,192.168.140.10,crc-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_compute-0_52:54:00:c4:56:fa', 'entry': 'set:compute,52:54:00:c4:56:fa,192.168.101.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_controller-0_52:54:01:68:a0:ec', 'entry': 'set:controller,52:54:01:68:a0:ec,192.168.101.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_crc-0_52:54:02:7a:e2:40', 'entry': 'set:ocp,52:54:02:7a:e2:40,192.168.101.10,crc-0', 'state': 'present'}) TASK [dnsmasq : Remove DHCP entries] ******************************************* Monday 24 November 2025 08:43:25 +0000 (0:00:02.070) 0:01:19.530 ******* skipping: [instance] TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** Monday 24 November 2025 08:43:25 +0000 (0:00:00.022) 0:01:19.553 ******* ok: [instance] => (item=compute-0) ok: [instance] => (item=controller-0) ok: [instance] => (item=crc-0) TASK [Inject VMs in the .utility zone] ***************************************** Monday 24 November 2025 08:43:26 +0000 (0:00:00.219) 0:01:19.772 ******* TASK [dnsmasq : Assert we have needed host record data] ************************ Monday 24 November 2025 08:43:26 +0000 (0:00:00.119) 0:01:19.891 ******* ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Monday 24 November 2025 08:43:26 +0000 (0:00:00.042) 0:01:19.934 ******* ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Monday 24 November 2025 08:43:26 +0000 (0:00:00.209) 0:01:20.143 ******* changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** Monday 24 November 2025 08:43:29 +0000 (0:00:03.273) 0:01:23.417 ******* ok: [instance] TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** Monday 24 November 2025 08:43:29 +0000 (0:00:00.021) 0:01:23.439 ******* skipping: [instance] => (item=compute) skipping: [instance] => (item=controller) skipping: [instance] => (item=crc) skipping: [instance] TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* Monday 24 November 2025 08:43:29 +0000 (0:00:00.043) 0:01:23.483 ******* skipping: [instance] TASK [libvirt_manager : Ensure some domains are local] ************************* Monday 24 November 2025 08:43:29 +0000 (0:00:00.031) 0:01:23.514 ******* changed: [instance] TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ Monday 24 November 2025 08:43:30 +0000 (0:00:00.412) 0:01:23.927 ******* RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Monday 24 November 2025 08:43:30 +0000 (0:00:00.011) 0:01:23.938 ******* changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Monday 24 November 2025 08:43:31 +0000 (0:00:00.809) 0:01:24.747 ******* changed: [instance] RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* Monday 24 November 2025 08:43:31 +0000 (0:00:00.344) 0:01:25.092 ******* changed: [instance] TASK [reproducer : Delegate our domains to our own instance] ******************* Monday 24 November 2025 08:43:31 +0000 (0:00:00.340) 0:01:25.432 ******* changed: [instance] TASK [reproducer : Ensure "utility" domain is local] *************************** Monday 24 November 2025 08:43:32 +0000 (0:00:00.364) 0:01:25.797 ******* changed: [instance] TASK [Build utility records dataset] ******************************************* Monday 24 November 2025 08:43:32 +0000 (0:00:00.374) 0:01:26.171 ******* TASK [dnsmasq : Assert we have needed host record data] ************************ Monday 24 November 2025 08:43:32 +0000 (0:00:00.032) 0:01:26.204 ******* ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Monday 24 November 2025 08:43:32 +0000 (0:00:00.094) 0:01:26.298 ******* ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Monday 24 November 2025 08:43:32 +0000 (0:00:00.100) 0:01:26.398 ******* changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [reproducer : Flush handlers] ********************************************* Monday 24 November 2025 08:43:33 +0000 (0:00:00.470) 0:01:26.869 ******* RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Monday 24 November 2025 08:43:33 +0000 (0:00:00.010) 0:01:26.879 ******* changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Monday 24 November 2025 08:43:33 +0000 (0:00:00.458) 0:01:27.338 ******* changed: [instance] TASK [reproducer : Bootstrap nat64 if needed] ********************************** Monday 24 November 2025 08:43:34 +0000 (0:00:00.354) 0:01:27.693 ******* skipping: [instance] TASK [reproducer : Deploy CRC if needed] *************************************** Monday 24 November 2025 08:43:34 +0000 (0:00:00.032) 0:01:27.726 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance TASK [reproducer : Check for CRC availability in known path] ******************* Monday 24 November 2025 08:43:34 +0000 (0:00:00.078) 0:01:27.805 ******* ok: [instance] TASK [Deploy CRC if needed] **************************************************** Monday 24 November 2025 08:43:34 +0000 (0:00:00.242) 0:01:28.048 ******* skipping: [instance] TASK [rhol_crc : Stop CRC VM] ************************************************** Monday 24 November 2025 08:43:34 +0000 (0:00:00.019) 0:01:28.067 ******* ok: [instance] TASK [rhol_crc : Undefine CRC VM] ********************************************** Monday 24 November 2025 08:43:34 +0000 (0:00:00.347) 0:01:28.415 ******* ok: [instance] TASK [rhol_crc : Destroy CRC network] ****************************************** Monday 24 November 2025 08:43:35 +0000 (0:00:00.229) 0:01:28.645 ******* ok: [instance] TASK [rhol_crc : Undefine CRC network] ***************************************** Monday 24 November 2025 08:43:35 +0000 (0:00:00.218) 0:01:28.863 ******* ok: [instance] TASK [rhol_crc : Destroy default network] ************************************** Monday 24 November 2025 08:43:35 +0000 (0:00:00.231) 0:01:29.095 ******* ok: [instance] TASK [Check if new ssh keypair exists] ***************************************** Monday 24 November 2025 08:43:35 +0000 (0:00:00.219) 0:01:29.314 ******* TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Monday 24 November 2025 08:43:35 +0000 (0:00:00.039) 0:01:29.354 ******* ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Monday 24 November 2025 08:43:35 +0000 (0:00:00.195) 0:01:29.549 ******* ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Monday 24 November 2025 08:43:36 +0000 (0:00:00.020) 0:01:29.570 ******* skipping: [instance] TASK [reproducer : Slurp ssh key for CRC access] ******************************* Monday 24 November 2025 08:43:36 +0000 (0:00:00.023) 0:01:29.593 ******* ok: [instance] TASK [reproducer : Get kubeconfig file from crc directory] ********************* Monday 24 November 2025 08:43:36 +0000 (0:00:00.286) 0:01:29.879 ******* ok: [instance] TASK [reproducer : Get kubeadmin-password file from crc directory] ************* Monday 24 November 2025 08:43:36 +0000 (0:00:00.219) 0:01:30.099 ******* ok: [instance] TASK [Ensure we expose openshift_login related facts] ************************** Monday 24 November 2025 08:43:36 +0000 (0:00:00.173) 0:01:30.272 ******* TASK [openshift_login : Assert we have needed parameters] ********************** Monday 24 November 2025 08:43:36 +0000 (0:00:00.057) 0:01:30.329 ******* ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Stat kubeconfig] *************************************** Monday 24 November 2025 08:43:36 +0000 (0:00:00.044) 0:01:30.374 ******* ok: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Monday 24 November 2025 08:43:36 +0000 (0:00:00.178) 0:01:30.553 ******* ok: [instance] TASK [openshift_login : Assert files exist] ************************************ Monday 24 November 2025 08:43:37 +0000 (0:00:00.219) 0:01:30.772 ******* ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Gather the password of the deployed cluster.] ********** Monday 24 November 2025 08:43:37 +0000 (0:00:00.024) 0:01:30.796 ******* ok: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Monday 24 November 2025 08:43:37 +0000 (0:00:00.184) 0:01:30.981 ******* ok: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Monday 24 November 2025 08:43:37 +0000 (0:00:00.200) 0:01:31.182 ******* ok: [instance] TASK [reproducer : Remove CRC managed zone delegation] ************************* Monday 24 November 2025 08:43:37 +0000 (0:00:00.049) 0:01:31.231 ******* changed: [instance] => (item=dnsmasq.d/crc.conf) changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ Monday 24 November 2025 08:43:38 +0000 (0:00:00.390) 0:01:31.622 ******* skipping: [instance] TASK [Load the architecture local kustomize patches] *************************** Monday 24 November 2025 08:43:38 +0000 (0:00:00.019) 0:01:31.641 ******* skipping: [instance] TASK [reproducer : Consume libvirt_manager] ************************************ Monday 24 November 2025 08:43:38 +0000 (0:00:00.024) 0:01:31.665 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance TASK [libvirt_manager : Import layout generator if needed] ********************* Monday 24 November 2025 08:43:38 +0000 (0:00:00.131) 0:01:31.797 ******* skipping: [instance] TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** Monday 24 November 2025 08:43:38 +0000 (0:00:00.024) 0:01:31.822 ******* changed: [instance] TASK [libvirt_manager : Enable masquerading for public traffic] **************** Monday 24 November 2025 08:43:38 +0000 (0:00:00.426) 0:01:32.249 ******* changed: [instance] TASK [libvirt_manager : Ensure firewalld is restarts] ************************** Monday 24 November 2025 08:43:39 +0000 (0:00:00.515) 0:01:32.764 ******* RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Monday 24 November 2025 08:43:39 +0000 (0:00:00.011) 0:01:32.775 ******* changed: [instance] RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Monday 24 November 2025 08:43:39 +0000 (0:00:00.426) 0:01:33.202 ******* changed: [instance] TASK [Deploy virtualbmc] ******************************************************* Monday 24 November 2025 08:43:40 +0000 (0:00:00.821) 0:01:34.023 ******* skipping: [instance] TASK [libvirt_manager : Let the project know we have vbmc available] *********** Monday 24 November 2025 08:43:40 +0000 (0:00:00.031) 0:01:34.055 ******* skipping: [instance] TASK [libvirt_manager : Create needed workload directory] ********************** Monday 24 November 2025 08:43:40 +0000 (0:00:00.031) 0:01:34.086 ******* changed: [instance] => (item=workload) changed: [instance] => (item=reproducer-inventory) ok: [instance] => (item=volumes) TASK [libvirt_manager : Allow QEMU on workload directory] ********************** Monday 24 November 2025 08:43:41 +0000 (0:00:00.538) 0:01:34.625 ******* changed: [instance] => (item=workload) changed: [instance] => (item=volumes) TASK [libvirt_manager : Generate networking data] ****************************** Monday 24 November 2025 08:43:41 +0000 (0:00:00.393) 0:01:35.019 ******* skipping: [instance] TASK [libvirt_manager : Create group inventories] ****************************** Monday 24 November 2025 08:43:41 +0000 (0:00:00.024) 0:01:35.044 ******* changed: [instance] => (item=compute) changed: [instance] => (item=controller) changed: [instance] => (item=crc) TASK [libvirt_manager : Create "all" group inventory file] ********************* Monday 24 November 2025 08:43:42 +0000 (0:00:01.027) 0:01:36.071 ******* changed: [instance] TASK [libvirt_manager : Ensure storage pool is present.] *********************** Monday 24 November 2025 08:43:42 +0000 (0:00:00.366) 0:01:36.438 ******* skipping: [instance] TASK [libvirt_manager : Ensure images are present] ***************************** Monday 24 November 2025 08:43:42 +0000 (0:00:00.038) 0:01:36.477 ******* skipping: [instance] => (item=crc) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) TASK [libvirt_manager : Ensure directory exists] ******************************* Monday 24 November 2025 08:43:42 +0000 (0:00:00.061) 0:01:36.539 ******* changed: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Monday 24 November 2025 08:43:43 +0000 (0:00:00.205) 0:01:36.744 ******* ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Monday 24 November 2025 08:43:43 +0000 (0:00:00.179) 0:01:36.924 ******* changed: [instance] TASK [libvirt_manager : Check image] ******************************************* Monday 24 November 2025 08:44:04 +0000 (0:00:21.151) 0:01:58.076 ******* ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Monday 24 November 2025 08:44:04 +0000 (0:00:00.236) 0:01:58.312 ******* ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Monday 24 November 2025 08:44:04 +0000 (0:00:00.041) 0:01:58.353 ******* changed: [instance] TASK [libvirt_manager : Ensure directory exists] ******************************* Monday 24 November 2025 08:44:05 +0000 (0:00:00.211) 0:01:58.564 ******* ok: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Monday 24 November 2025 08:44:05 +0000 (0:00:00.207) 0:01:58.772 ******* ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Monday 24 November 2025 08:44:05 +0000 (0:00:00.197) 0:01:58.969 ******* skipping: [instance] TASK [libvirt_manager : Check image] ******************************************* Monday 24 November 2025 08:44:05 +0000 (0:00:00.021) 0:01:58.991 ******* ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Monday 24 November 2025 08:44:05 +0000 (0:00:00.223) 0:01:59.214 ******* ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Monday 24 November 2025 08:44:05 +0000 (0:00:00.041) 0:01:59.256 ******* ok: [instance] TASK [libvirt_manager : Get ssh key state] ************************************* Monday 24 November 2025 08:44:05 +0000 (0:00:00.210) 0:01:59.466 ******* ok: [instance] TASK [libvirt_manager : Create temporary ssh keypair] ************************** Monday 24 November 2025 08:44:06 +0000 (0:00:00.180) 0:01:59.646 ******* changed: [instance] TASK [libvirt_manager : Slurp public key for later use] ************************ Monday 24 November 2025 08:44:06 +0000 (0:00:00.360) 0:02:00.007 ******* ok: [instance] TASK [libvirt_manager : Slurp private key for later use] *********************** Monday 24 November 2025 08:44:06 +0000 (0:00:00.177) 0:02:00.185 ******* ok: [instance] TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** Monday 24 November 2025 08:44:06 +0000 (0:00:00.182) 0:02:00.367 ******* changed: [instance] TASK [libvirt_manager : Create fact holding network data for VMs] ************** Monday 24 November 2025 08:44:07 +0000 (0:00:00.407) 0:02:00.775 ******* ok: [instance] TASK [libvirt_manager : List existing networks] ******************************** Monday 24 November 2025 08:44:07 +0000 (0:00:00.020) 0:02:00.796 ******* ok: [instance] TASK [libvirt_manager : Gather pool fact] ************************************** Monday 24 November 2025 08:44:07 +0000 (0:00:00.228) 0:02:01.024 ******* ok: [instance] TASK [libvirt_manager : Create and run VMs] ************************************ Monday 24 November 2025 08:44:07 +0000 (0:00:00.468) 0:02:01.493 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Create VM image for compute-0] ************************* Monday 24 November 2025 08:44:08 +0000 (0:00:00.123) 0:02:01.617 ******* changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** Monday 24 November 2025 08:44:08 +0000 (0:00:00.261) 0:02:01.878 ******* changed: [instance] TASK [libvirt_manager : Define VMs for type compute-0] ************************* Monday 24 November 2025 08:44:08 +0000 (0:00:00.226) 0:02:02.105 ******* changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** Monday 24 November 2025 08:44:08 +0000 (0:00:00.293) 0:02:02.398 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Monday 24 November 2025 08:44:08 +0000 (0:00:00.029) 0:02:02.428 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Monday 24 November 2025 08:44:08 +0000 (0:00:00.045) 0:02:02.474 ******* ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 24 November 2025 08:44:09 +0000 (0:00:00.231) 0:02:02.706 ******* ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 24 November 2025 08:44:09 +0000 (0:00:00.044) 0:02:02.750 ******* ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 24 November 2025 08:44:09 +0000 (0:00:00.238) 0:02:02.989 ******* ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ Monday 24 November 2025 08:44:09 +0000 (0:00:00.205) 0:02:03.194 ******* changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Monday 24 November 2025 08:44:10 +0000 (0:00:01.297) 0:02:04.492 ******* ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 24 November 2025 08:44:11 +0000 (0:00:00.229) 0:02:04.722 ******* ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 24 November 2025 08:44:11 +0000 (0:00:00.043) 0:02:04.765 ******* ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 24 November 2025 08:44:11 +0000 (0:00:00.228) 0:02:04.993 ******* ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* Monday 24 November 2025 08:44:11 +0000 (0:00:00.199) 0:02:05.193 ******* changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** Monday 24 November 2025 08:44:11 +0000 (0:00:00.283) 0:02:05.477 ******* skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** Monday 24 November 2025 08:44:11 +0000 (0:00:00.021) 0:02:05.498 ******* skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** Monday 24 November 2025 08:44:11 +0000 (0:00:00.028) 0:02:05.526 ******* skipping: [instance] TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** Monday 24 November 2025 08:44:11 +0000 (0:00:00.027) 0:02:05.554 ******* skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Monday 24 November 2025 08:44:12 +0000 (0:00:00.026) 0:02:05.580 ******* changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Monday 24 November 2025 08:44:12 +0000 (0:00:00.212) 0:02:05.792 ******* ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Monday 24 November 2025 08:44:12 +0000 (0:00:00.037) 0:02:05.830 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Monday 24 November 2025 08:44:12 +0000 (0:00:00.053) 0:02:05.883 ******* ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Monday 24 November 2025 08:44:12 +0000 (0:00:00.194) 0:02:06.078 ******* ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Monday 24 November 2025 08:44:12 +0000 (0:00:00.062) 0:02:06.140 ******* ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Monday 24 November 2025 08:44:12 +0000 (0:00:00.045) 0:02:06.185 ******* skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Monday 24 November 2025 08:44:12 +0000 (0:00:00.042) 0:02:06.228 ******* skipping: [instance] TASK [Call the config_drive role] ********************************************** Monday 24 November 2025 08:44:12 +0000 (0:00:00.042) 0:02:06.270 ******* TASK [config_drive : Ensure needed directories exist] ************************** Monday 24 November 2025 08:44:12 +0000 (0:00:00.059) 0:02:06.330 ******* ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Monday 24 November 2025 08:44:13 +0000 (0:00:00.399) 0:02:06.729 ******* ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Monday 24 November 2025 08:44:14 +0000 (0:00:01.238) 0:02:07.967 ******* changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Monday 24 November 2025 08:44:14 +0000 (0:00:00.219) 0:02:08.186 ******* changed: [instance] TASK [config_drive : Generate user-data] *************************************** Monday 24 November 2025 08:44:15 +0000 (0:00:00.378) 0:02:08.565 ******* changed: [instance] TASK [config_drive : Generate network-data] ************************************ Monday 24 November 2025 08:44:15 +0000 (0:00:00.387) 0:02:08.952 ******* skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Monday 24 November 2025 08:44:15 +0000 (0:00:00.045) 0:02:08.997 ******* ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Monday 24 November 2025 08:44:15 +0000 (0:00:00.204) 0:02:09.202 ******* skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Monday 24 November 2025 08:44:15 +0000 (0:00:00.044) 0:02:09.246 ******* Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Monday 24 November 2025 08:44:15 +0000 (0:00:00.239) 0:02:09.486 ******* changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Monday 24 November 2025 08:44:16 +0000 (0:00:00.309) 0:02:09.795 ******* skipping: [instance] TASK [libvirt_manager : Configure boot order for compute-0] ******************** Monday 24 November 2025 08:44:16 +0000 (0:00:00.047) 0:02:09.842 ******* skipping: [instance] TASK [libvirt_manager : Create VM image for controller-0] ********************** Monday 24 November 2025 08:44:16 +0000 (0:00:00.028) 0:02:09.871 ******* changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** Monday 24 November 2025 08:44:16 +0000 (0:00:00.247) 0:02:10.119 ******* changed: [instance] TASK [libvirt_manager : Define VMs for type controller-0] ********************** Monday 24 November 2025 08:44:16 +0000 (0:00:00.229) 0:02:10.348 ******* changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** Monday 24 November 2025 08:44:17 +0000 (0:00:00.294) 0:02:10.643 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Monday 24 November 2025 08:44:17 +0000 (0:00:00.048) 0:02:10.691 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Monday 24 November 2025 08:44:17 +0000 (0:00:00.051) 0:02:10.743 ******* ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 24 November 2025 08:44:17 +0000 (0:00:00.236) 0:02:10.979 ******* ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 24 November 2025 08:44:17 +0000 (0:00:00.045) 0:02:11.025 ******* ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 24 November 2025 08:44:17 +0000 (0:00:00.237) 0:02:11.262 ******* ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* Monday 24 November 2025 08:44:17 +0000 (0:00:00.199) 0:02:11.462 ******* changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Monday 24 November 2025 08:44:19 +0000 (0:00:01.301) 0:02:12.763 ******* ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 24 November 2025 08:44:19 +0000 (0:00:00.233) 0:02:12.996 ******* ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 24 November 2025 08:44:19 +0000 (0:00:00.045) 0:02:13.042 ******* ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 24 November 2025 08:44:19 +0000 (0:00:00.231) 0:02:13.273 ******* ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** Monday 24 November 2025 08:44:19 +0000 (0:00:00.208) 0:02:13.482 ******* changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** Monday 24 November 2025 08:44:20 +0000 (0:00:00.323) 0:02:13.806 ******* skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** Monday 24 November 2025 08:44:20 +0000 (0:00:00.020) 0:02:13.827 ******* skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** Monday 24 November 2025 08:44:20 +0000 (0:00:00.027) 0:02:13.854 ******* skipping: [instance] TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** Monday 24 November 2025 08:44:20 +0000 (0:00:00.028) 0:02:13.883 ******* skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Monday 24 November 2025 08:44:20 +0000 (0:00:00.025) 0:02:13.909 ******* changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Monday 24 November 2025 08:44:20 +0000 (0:00:00.215) 0:02:14.125 ******* ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Monday 24 November 2025 08:44:20 +0000 (0:00:00.037) 0:02:14.162 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Monday 24 November 2025 08:44:20 +0000 (0:00:00.053) 0:02:14.215 ******* ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Monday 24 November 2025 08:44:20 +0000 (0:00:00.197) 0:02:14.412 ******* ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Monday 24 November 2025 08:44:20 +0000 (0:00:00.061) 0:02:14.474 ******* ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Monday 24 November 2025 08:44:20 +0000 (0:00:00.046) 0:02:14.521 ******* skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Monday 24 November 2025 08:44:21 +0000 (0:00:00.042) 0:02:14.564 ******* skipping: [instance] TASK [Call the config_drive role] ********************************************** Monday 24 November 2025 08:44:21 +0000 (0:00:00.043) 0:02:14.607 ******* TASK [config_drive : Ensure needed directories exist] ************************** Monday 24 November 2025 08:44:21 +0000 (0:00:00.059) 0:02:14.667 ******* ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Monday 24 November 2025 08:44:21 +0000 (0:00:00.405) 0:02:15.072 ******* ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Monday 24 November 2025 08:44:22 +0000 (0:00:01.224) 0:02:16.297 ******* changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Monday 24 November 2025 08:44:22 +0000 (0:00:00.214) 0:02:16.511 ******* changed: [instance] TASK [config_drive : Generate user-data] *************************************** Monday 24 November 2025 08:44:23 +0000 (0:00:00.398) 0:02:16.910 ******* changed: [instance] TASK [config_drive : Generate network-data] ************************************ Monday 24 November 2025 08:44:23 +0000 (0:00:00.411) 0:02:17.321 ******* skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Monday 24 November 2025 08:44:23 +0000 (0:00:00.044) 0:02:17.366 ******* ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Monday 24 November 2025 08:44:24 +0000 (0:00:00.204) 0:02:17.571 ******* skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Monday 24 November 2025 08:44:24 +0000 (0:00:00.077) 0:02:17.648 ******* Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Monday 24 November 2025 08:44:24 +0000 (0:00:00.234) 0:02:17.883 ******* changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Monday 24 November 2025 08:44:24 +0000 (0:00:00.275) 0:02:18.158 ******* skipping: [instance] TASK [libvirt_manager : Configure boot order for controller-0] ***************** Monday 24 November 2025 08:44:24 +0000 (0:00:00.046) 0:02:18.205 ******* skipping: [instance] TASK [libvirt_manager : Create VM image for crc-0] ***************************** Monday 24 November 2025 08:44:24 +0000 (0:00:00.028) 0:02:18.234 ******* changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ Monday 24 November 2025 08:44:24 +0000 (0:00:00.247) 0:02:18.481 ******* changed: [instance] TASK [libvirt_manager : Define VMs for type crc-0] ***************************** Monday 24 November 2025 08:44:25 +0000 (0:00:00.226) 0:02:18.707 ******* changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** Monday 24 November 2025 08:44:25 +0000 (0:00:00.296) 0:02:19.003 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Monday 24 November 2025 08:44:25 +0000 (0:00:00.029) 0:02:19.033 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Monday 24 November 2025 08:44:25 +0000 (0:00:00.045) 0:02:19.079 ******* ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 24 November 2025 08:44:25 +0000 (0:00:00.234) 0:02:19.313 ******* ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 24 November 2025 08:44:25 +0000 (0:00:00.046) 0:02:19.359 ******* ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 24 November 2025 08:44:26 +0000 (0:00:00.233) 0:02:19.592 ******* ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** Monday 24 November 2025 08:44:26 +0000 (0:00:00.201) 0:02:19.794 ******* changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Monday 24 November 2025 08:44:27 +0000 (0:00:01.317) 0:02:21.112 ******* ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 24 November 2025 08:44:27 +0000 (0:00:00.225) 0:02:21.337 ******* ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 24 November 2025 08:44:27 +0000 (0:00:00.045) 0:02:21.383 ******* ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 24 November 2025 08:44:28 +0000 (0:00:00.228) 0:02:21.611 ******* ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* Monday 24 November 2025 08:44:28 +0000 (0:00:00.200) 0:02:21.812 ******* changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* Monday 24 November 2025 08:44:28 +0000 (0:00:00.285) 0:02:22.097 ******* skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ Monday 24 November 2025 08:44:28 +0000 (0:00:00.021) 0:02:22.119 ******* skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** Monday 24 November 2025 08:44:28 +0000 (0:00:00.027) 0:02:22.147 ******* skipping: [instance] TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** Monday 24 November 2025 08:44:28 +0000 (0:00:00.027) 0:02:22.174 ******* skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Monday 24 November 2025 08:44:28 +0000 (0:00:00.026) 0:02:22.200 ******* changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Monday 24 November 2025 08:44:28 +0000 (0:00:00.213) 0:02:22.414 ******* ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Monday 24 November 2025 08:44:28 +0000 (0:00:00.036) 0:02:22.451 ******* skipping: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Monday 24 November 2025 08:44:28 +0000 (0:00:00.027) 0:02:22.478 ******* skipping: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Monday 24 November 2025 08:44:28 +0000 (0:00:00.026) 0:02:22.505 ******* skipping: [instance] TASK [libvirt_manager : Configure boot order for crc-0] ************************ Monday 24 November 2025 08:44:28 +0000 (0:00:00.047) 0:02:22.552 ******* skipping: [instance] TASK [libvirt_manager : Start (power-on) VMs] ********************************** Monday 24 November 2025 08:44:29 +0000 (0:00:00.026) 0:02:22.578 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** Monday 24 November 2025 08:44:29 +0000 (0:00:00.061) 0:02:22.639 ******* ok: [instance] => (item=crc) TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** Monday 24 November 2025 08:44:29 +0000 (0:00:00.239) 0:02:22.879 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Start vm] ********************************************** Monday 24 November 2025 08:44:31 +0000 (0:00:02.070) 0:02:24.949 ******* changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Monday 24 November 2025 08:44:32 +0000 (0:00:00.849) 0:02:25.798 ******* changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Monday 24 November 2025 08:44:32 +0000 (0:00:00.755) 0:02:26.554 ******* changed: [instance] TASK [libvirt_manager : Wait for SSH on started VMs] *************************** Monday 24 November 2025 08:44:33 +0000 (0:00:00.832) 0:02:27.387 ******* changed: [instance] => (item=compute-0.utility) changed: [instance] => (item=controller-0.utility) changed: [instance] => (item=crc-0.utility) TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** Monday 24 November 2025 08:44:34 +0000 (0:00:00.745) 0:02:28.132 ******* FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j374076604267.24073', 'results_file': '/home/zuul/.ansible_async/j374076604267.24073', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j304248200626.24091', 'results_file': '/home/zuul/.ansible_async/j304248200626.24091', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j88230823478.24107', 'results_file': '/home/zuul/.ansible_async/j88230823478.24107', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) TASK [libvirt_manager : Configure managed VMs] ********************************* Monday 24 November 2025 08:44:54 +0000 (0:00:19.811) 0:02:47.944 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [Check if new ssh keypair exists] ***************************************** Monday 24 November 2025 08:44:54 +0000 (0:00:00.147) 0:02:48.092 ******* skipping: [instance] TASK [Push ssh jumper/configuration for compute-0] ***************************** Monday 24 November 2025 08:44:54 +0000 (0:00:00.022) 0:02:48.115 ******* TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Monday 24 November 2025 08:44:54 +0000 (0:00:00.038) 0:02:48.153 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Monday 24 November 2025 08:44:54 +0000 (0:00:00.081) 0:02:48.234 ******* changed: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Monday 24 November 2025 08:44:54 +0000 (0:00:00.226) 0:02:48.461 ******* changed: [instance] TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* Monday 24 November 2025 08:44:55 +0000 (0:00:00.219) 0:02:48.681 ******* changed: [instance] TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** Monday 24 November 2025 08:44:55 +0000 (0:00:00.390) 0:02:49.071 ******* skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Monday 24 November 2025 08:44:55 +0000 (0:00:00.029) 0:02:49.100 ******* skipping: [instance] TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** Monday 24 November 2025 08:44:55 +0000 (0:00:00.028) 0:02:49.129 ******* skipping: [instance] TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** Monday 24 November 2025 08:44:55 +0000 (0:00:00.047) 0:02:49.176 ******* skipping: [instance] TASK [Check if new ssh keypair exists] ***************************************** Monday 24 November 2025 08:44:55 +0000 (0:00:00.044) 0:02:49.221 ******* skipping: [instance] TASK [Push ssh jumper/configuration for controller-0] ************************** Monday 24 November 2025 08:44:55 +0000 (0:00:00.022) 0:02:49.244 ******* TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Monday 24 November 2025 08:44:55 +0000 (0:00:00.035) 0:02:49.280 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Monday 24 November 2025 08:44:55 +0000 (0:00:00.082) 0:02:49.362 ******* ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Monday 24 November 2025 08:44:56 +0000 (0:00:00.217) 0:02:49.579 ******* ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** Monday 24 November 2025 08:44:56 +0000 (0:00:00.208) 0:02:49.788 ******* changed: [instance] TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** Monday 24 November 2025 08:44:56 +0000 (0:00:00.389) 0:02:50.178 ******* skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Monday 24 November 2025 08:44:56 +0000 (0:00:00.027) 0:02:50.205 ******* skipping: [instance] TASK [libvirt_manager : Inject private key on hosts controller-0] ************** Monday 24 November 2025 08:44:56 +0000 (0:00:00.027) 0:02:50.232 ******* changed: [instance -> controller-0.instance] TASK [libvirt_manager : Inject public key on hosts controller-0] *************** Monday 24 November 2025 08:44:58 +0000 (0:00:01.554) 0:02:51.787 ******* changed: [instance -> controller-0.instance] TASK [Check if new ssh keypair exists] ***************************************** Monday 24 November 2025 08:44:59 +0000 (0:00:01.095) 0:02:52.883 ******* TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Monday 24 November 2025 08:44:59 +0000 (0:00:00.039) 0:02:52.923 ******* ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Monday 24 November 2025 08:44:59 +0000 (0:00:00.210) 0:02:53.133 ******* ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Monday 24 November 2025 08:44:59 +0000 (0:00:00.024) 0:02:53.158 ******* skipping: [instance] TASK [Push ssh jumper/configuration for crc-0] ********************************* Monday 24 November 2025 08:44:59 +0000 (0:00:00.035) 0:02:53.193 ******* TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Monday 24 November 2025 08:44:59 +0000 (0:00:00.063) 0:02:53.257 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Monday 24 November 2025 08:44:59 +0000 (0:00:00.095) 0:02:53.352 ******* ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Monday 24 November 2025 08:45:00 +0000 (0:00:00.213) 0:02:53.566 ******* ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** Monday 24 November 2025 08:45:00 +0000 (0:00:00.210) 0:02:53.777 ******* changed: [instance] TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** Monday 24 November 2025 08:45:00 +0000 (0:00:00.388) 0:02:54.166 ******* changed: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Monday 24 November 2025 08:45:01 +0000 (0:00:00.770) 0:02:54.937 ******* skipping: [instance] TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* Monday 24 November 2025 08:45:01 +0000 (0:00:00.025) 0:02:54.963 ******* skipping: [instance] TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** Monday 24 November 2025 08:45:01 +0000 (0:00:00.043) 0:02:55.006 ******* skipping: [instance] TASK [Create VBMC entity] ****************************************************** Monday 24 November 2025 08:45:01 +0000 (0:00:00.043) 0:02:55.049 ******* skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) skipping: [instance] TASK [libvirt_manager : List running virtual machines.] ************************ Monday 24 November 2025 08:45:01 +0000 (0:00:00.048) 0:02:55.097 ******* ok: [instance] TASK [libvirt_manager : Dump UUIDs] ******************************************** Monday 24 November 2025 08:45:01 +0000 (0:00:00.257) 0:02:55.354 ******* changed: [instance] TASK [Ensure fresh vbmc listing] *********************************************** Monday 24 November 2025 08:45:02 +0000 (0:00:00.356) 0:02:55.711 ******* skipping: [instance] TASK [libvirt_manager : Update vbmc related fact] ****************************** Monday 24 November 2025 08:45:02 +0000 (0:00:00.033) 0:02:55.744 ******* skipping: [instance] TASK [libvirt_manager : Dump vbmc known hosts] ********************************* Monday 24 November 2025 08:45:02 +0000 (0:00:00.032) 0:02:55.777 ******* skipping: [instance] TASK [libvirt_manager : Copy authorized_keys] ********************************** Monday 24 November 2025 08:45:02 +0000 (0:00:00.033) 0:02:55.810 ******* changed: [instance] TASK [libvirt_manager : Enable root access on CRC] ***************************** Monday 24 November 2025 08:45:02 +0000 (0:00:00.645) 0:02:56.456 ******* changed: [instance] TASK [reproducer : Get deployed VM group inventories] ************************** Monday 24 November 2025 08:45:03 +0000 (0:00:00.553) 0:02:57.009 ******* skipping: [instance] TASK [reproducer : Inject remote inventories onto main hypervisor] ************* Monday 24 November 2025 08:45:03 +0000 (0:00:00.040) 0:02:57.050 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) TASK [reproducer : Gather inventories from instance] *************************** Monday 24 November 2025 08:45:03 +0000 (0:00:00.060) 0:02:57.110 ******* skipping: [instance] TASK [reproducer : Gather inventories from compute-0] ************************** Monday 24 November 2025 08:45:03 +0000 (0:00:00.040) 0:02:57.151 ******* skipping: [instance] TASK [reproducer : Gather inventories from controller-0] *********************** Monday 24 November 2025 08:45:03 +0000 (0:00:00.035) 0:02:57.186 ******* skipping: [instance] TASK [reproducer : Gather inventories from crc-0] ****************************** Monday 24 November 2025 08:45:03 +0000 (0:00:00.034) 0:02:57.220 ******* skipping: [instance] TASK [reproducer : Push generated inventory from hypervisor] ******************* Monday 24 November 2025 08:45:03 +0000 (0:00:00.033) 0:02:57.254 ******* changed: [instance] TASK [reproducer : Slurp devscripts private key] ******************************* Monday 24 November 2025 08:45:04 +0000 (0:00:00.576) 0:02:57.830 ******* skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** Monday 24 November 2025 08:45:04 +0000 (0:00:00.031) 0:02:57.862 ******* skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* Monday 24 November 2025 08:45:04 +0000 (0:00:00.031) 0:02:57.894 ******* skipping: [instance] TASK [openshift_login : Assert we have needed parameters] ********************** Monday 24 November 2025 08:45:04 +0000 (0:00:00.031) 0:02:57.925 ******* skipping: [instance] TASK [openshift_login : Stat kubeconfig] *************************************** Monday 24 November 2025 08:45:04 +0000 (0:00:00.030) 0:02:57.956 ******* skipping: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Monday 24 November 2025 08:45:04 +0000 (0:00:00.033) 0:02:57.989 ******* skipping: [instance] TASK [openshift_login : Assert files exist] ************************************ Monday 24 November 2025 08:45:04 +0000 (0:00:00.031) 0:02:58.021 ******* skipping: [instance] TASK [openshift_login : Gather the password of the deployed cluster.] ********** Monday 24 November 2025 08:45:04 +0000 (0:00:00.030) 0:02:58.052 ******* skipping: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Monday 24 November 2025 08:45:04 +0000 (0:00:00.030) 0:02:58.082 ******* skipping: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Monday 24 November 2025 08:45:04 +0000 (0:00:00.031) 0:02:58.114 ******* skipping: [instance] TASK [reproducer : Set fact for later wait on OCP cluster] ********************* Monday 24 November 2025 08:45:04 +0000 (0:00:00.081) 0:02:58.195 ******* skipping: [instance] TASK [reproducer : Configure Controller node] ********************************** Monday 24 November 2025 08:45:04 +0000 (0:00:00.030) 0:02:58.226 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance TASK [reproducer : Ensure directories exist] *********************************** Monday 24 November 2025 08:45:04 +0000 (0:00:00.155) 0:02:58.381 ******* changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Tweak dnf configuration] ************************************ Monday 24 November 2025 08:45:06 +0000 (0:00:01.221) 0:02:59.603 ******* skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Monday 24 November 2025 08:45:06 +0000 (0:00:00.018) 0:02:59.621 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Monday 24 November 2025 08:45:06 +0000 (0:00:00.572) 0:03:00.194 ******* skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Monday 24 November 2025 08:45:06 +0000 (0:00:00.033) 0:03:00.227 ******* skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Monday 24 November 2025 08:45:06 +0000 (0:00:00.034) 0:03:00.262 ******* skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Monday 24 November 2025 08:45:06 +0000 (0:00:00.035) 0:03:00.297 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get rhos-release] ******************************************* Monday 24 November 2025 08:45:08 +0000 (0:00:01.619) 0:03:01.916 ******* skipping: [instance] TASK [reproducer : Install repos] ********************************************** Monday 24 November 2025 08:45:08 +0000 (0:00:00.031) 0:03:01.948 ******* skipping: [instance] TASK [reproducer : Run custom commands after rhos-release setup] *************** Monday 24 November 2025 08:45:08 +0000 (0:00:00.034) 0:03:01.982 ******* skipping: [instance] TASK [reproducer : Create bundle for CRC] ************************************** Monday 24 November 2025 08:45:08 +0000 (0:00:00.034) 0:03:02.016 ******* skipping: [instance] TASK [reproducer : Install some tools] ***************************************** Monday 24 November 2025 08:45:08 +0000 (0:00:00.033) 0:03:02.049 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject command aliases for faster debugging] **************** Monday 24 November 2025 08:45:09 +0000 (0:00:01.077) 0:03:03.126 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Build job inventory for hook usage] ************************* Monday 24 November 2025 08:45:10 +0000 (0:00:01.188) 0:03:04.315 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Push the MAC mapping data] ********************************** Monday 24 November 2025 08:45:11 +0000 (0:00:00.570) 0:03:04.885 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject other Hypervisor SSH keys] *************************** Monday 24 November 2025 08:45:12 +0000 (0:00:01.018) 0:03:05.903 ******* changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** Monday 24 November 2025 08:45:13 +0000 (0:00:01.103) 0:03:07.007 ******* changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject SSH configuration] *********************************** Monday 24 November 2025 08:45:14 +0000 (0:00:00.646) 0:03:07.654 ******* skipping: [instance] => (item=instance) changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) TASK [reproducer : Create kube directory] ************************************** Monday 24 November 2025 08:45:15 +0000 (0:00:01.772) 0:03:09.426 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeconfig content] ********************************** Monday 24 November 2025 08:45:16 +0000 (0:00:00.587) 0:03:10.013 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeadmin-password if exists] ************************ Monday 24 November 2025 08:45:17 +0000 (0:00:00.957) 0:03:10.971 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject devscripts private key if set] *********************** Monday 24 November 2025 08:45:18 +0000 (0:00:00.961) 0:03:11.933 ******* skipping: [instance] TASK [reproducer : Ensure /etc/ci/env is created] ****************************** Monday 24 November 2025 08:45:18 +0000 (0:00:00.033) 0:03:11.967 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Ensure directory tree exist] **************************** Monday 24 November 2025 08:45:19 +0000 (0:00:00.604) 0:03:12.571 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Assert we get needed data] ****************************** Monday 24 November 2025 08:45:19 +0000 (0:00:00.636) 0:03:13.207 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Push reproducer secrets] ******************************** Monday 24 November 2025 08:45:19 +0000 (0:00:00.040) 0:03:13.248 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) TASK [manage_secrets : Debug _secret_dest] ************************************* Monday 24 November 2025 08:45:19 +0000 (0:00:00.062) 0:03:13.311 ******* ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt TASK [manage_secrets : Debug _secret_file] ************************************* Monday 24 November 2025 08:45:19 +0000 (0:00:00.053) 0:03:13.364 ******* ok: [instance -> controller-0(controller-0.instance)] => _secret_file: '' TASK [manage_secrets : Debug _secret_content] ********************************** Monday 24 November 2025 08:45:19 +0000 (0:00:00.048) 0:03:13.413 ******* ok: [instance -> controller-0(controller-0.instance)] => _secret_content: my-default-location-place TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Monday 24 November 2025 08:45:19 +0000 (0:00:00.047) 0:03:13.461 ******* skipping: [instance] TASK [manage_secrets : Check if pull secret src file exists] ******************* Monday 24 November 2025 08:45:19 +0000 (0:00:00.046) 0:03:13.507 ******* skipping: [instance] TASK [manage_secrets : Copy file to location] ********************************** Monday 24 November 2025 08:45:19 +0000 (0:00:00.051) 0:03:13.559 ******* skipping: [instance] TASK [manage_secrets : Create file from content] ******************************* Monday 24 November 2025 08:45:20 +0000 (0:00:00.048) 0:03:13.607 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Debug _secret_dest] ************************************* Monday 24 November 2025 08:45:21 +0000 (0:00:00.992) 0:03:14.599 ******* ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ipmi-things TASK [manage_secrets : Debug _secret_file] ************************************* Monday 24 November 2025 08:45:21 +0000 (0:00:00.052) 0:03:14.652 ******* ok: [instance -> controller-0(controller-0.instance)] => _secret_file: /tmp/ipmi-things TASK [manage_secrets : Debug _secret_content] ********************************** Monday 24 November 2025 08:45:21 +0000 (0:00:00.047) 0:03:14.699 ******* ok: [instance -> controller-0(controller-0.instance)] => _secret_content: '' TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Monday 24 November 2025 08:45:21 +0000 (0:00:00.093) 0:03:14.792 ******* ok: [instance -> controller-0(controller-0.instance)] => changed=false msg: All assertions passed TASK [manage_secrets : Check if pull secret src file exists] ******************* Monday 24 November 2025 08:45:21 +0000 (0:00:00.054) 0:03:14.847 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Copy file to location] ********************************** Monday 24 November 2025 08:45:21 +0000 (0:00:00.569) 0:03:15.417 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Create file from content] ******************************* Monday 24 November 2025 08:45:22 +0000 (0:00:00.997) 0:03:16.415 ******* skipping: [instance] TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** Monday 24 November 2025 08:45:22 +0000 (0:00:00.052) 0:03:16.467 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check if async file is still available] ********************* Monday 24 November 2025 08:45:23 +0000 (0:00:00.548) 0:03:17.016 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check package install status] ******************************* Monday 24 November 2025 08:45:24 +0000 (0:00:00.577) 0:03:17.594 ******* FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** Monday 24 November 2025 08:46:25 +0000 (0:01:01.088) 0:04:18.682 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Install required packages] ****************************** Monday 24 November 2025 08:46:25 +0000 (0:00:00.685) 0:04:19.368 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get ingresses domain] *********************************** Monday 24 November 2025 08:46:28 +0000 (0:00:02.555) 0:04:21.923 ******* skipping: [instance] TASK [sushy_emulator : Set sushy url for ocp installation] ********************* Monday 24 November 2025 08:46:28 +0000 (0:00:00.046) 0:04:21.970 ******* skipping: [instance] TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** Monday 24 November 2025 08:46:28 +0000 (0:00:00.045) 0:04:22.016 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp private ssh key for later use] ******************** Monday 24 November 2025 08:46:29 +0000 (0:00:00.640) 0:04:22.656 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* Monday 24 November 2025 08:46:29 +0000 (0:00:00.583) 0:04:23.240 ******* changed: [instance] TASK [sushy_emulator : Run ssh-keyscan] **************************************** Monday 24 November 2025 08:46:29 +0000 (0:00:00.312) 0:04:23.552 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write known hosts for later use] ************************ Monday 24 November 2025 08:46:30 +0000 (0:00:00.671) 0:04:24.224 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Monday 24 November 2025 08:46:31 +0000 (0:00:01.013) 0:04:25.238 ******* skipping: [instance] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Monday 24 November 2025 08:46:31 +0000 (0:00:00.044) 0:04:25.283 ******* skipping: [instance] TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Monday 24 November 2025 08:46:31 +0000 (0:00:00.043) 0:04:25.326 ******* skipping: [instance] TASK [sushy_emulator : Generate list of filtered VMs] ************************** Monday 24 November 2025 08:46:31 +0000 (0:00:00.041) 0:04:25.367 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** Monday 24 November 2025 08:46:31 +0000 (0:00:00.052) 0:04:25.420 ******* skipping: [instance] TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** Monday 24 November 2025 08:46:31 +0000 (0:00:00.037) 0:04:25.458 ******* skipping: [instance] TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** Monday 24 November 2025 08:46:31 +0000 (0:00:00.037) 0:04:25.495 ******* skipping: [instance] TASK [sushy_emulator : Generate htpasswd string] ******************************* Monday 24 November 2025 08:46:31 +0000 (0:00:00.040) 0:04:25.536 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write sushy emulator resource loop] ********************* Monday 24 November 2025 08:46:32 +0000 (0:00:00.572) 0:04:26.108 ******* skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=pod) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Write sushy emulator config] **************************** Monday 24 November 2025 08:46:32 +0000 (0:00:00.104) 0:04:26.212 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write htpasswd string to file] ************************** Monday 24 November 2025 08:46:33 +0000 (0:00:01.048) 0:04:27.261 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** Monday 24 November 2025 08:46:34 +0000 (0:00:01.056) 0:04:28.318 ******* skipping: [instance] TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** Monday 24 November 2025 08:46:34 +0000 (0:00:00.040) 0:04:28.359 ******* skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* Monday 24 November 2025 08:46:34 +0000 (0:00:00.040) 0:04:28.400 ******* skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** Monday 24 November 2025 08:46:34 +0000 (0:00:00.081) 0:04:28.481 ******* skipping: [instance] TASK [podman : Ensure podman is installed] ************************************* Monday 24 November 2025 08:46:34 +0000 (0:00:00.043) 0:04:28.525 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [podman : Enable loginctl linger for ansible_user_id] ********************* Monday 24 November 2025 08:46:36 +0000 (0:00:01.512) 0:04:30.037 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* Monday 24 November 2025 08:46:37 +0000 (0:00:00.772) 0:04:30.809 ******* skipping: [instance] TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* Monday 24 November 2025 08:46:37 +0000 (0:00:00.051) 0:04:30.861 ******* skipping: [instance] TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** Monday 24 November 2025 08:46:37 +0000 (0:00:00.042) 0:04:30.903 ******* skipping: [instance] TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** Monday 24 November 2025 08:46:37 +0000 (0:00:00.046) 0:04:30.950 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create and start Sushy Emulator container] ************** Monday 24 November 2025 08:46:47 +0000 (0:00:10.224) 0:04:41.175 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure directories exist] *********************************** Monday 24 November 2025 08:46:49 +0000 (0:00:01.421) 0:04:42.596 ******* ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Convert VBMC list into a dict for better usage] ************* Monday 24 November 2025 08:46:50 +0000 (0:00:01.182) 0:04:43.779 ******* skipping: [instance] TASK [reproducer : Check if baremetal-info.yml exists] ************************* Monday 24 November 2025 08:46:50 +0000 (0:00:00.041) 0:04:43.820 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get content of baremetal-info file] ************************* Monday 24 November 2025 08:46:50 +0000 (0:00:00.579) 0:04:44.400 ******* skipping: [instance] TASK [reproducer : Interpret remote file content as yaml] ********************** Monday 24 November 2025 08:46:50 +0000 (0:00:00.038) 0:04:44.438 ******* skipping: [instance] TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Monday 24 November 2025 08:46:50 +0000 (0:00:00.045) 0:04:44.483 ******* skipping: [instance] TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Monday 24 November 2025 08:46:50 +0000 (0:00:00.043) 0:04:44.527 ******* skipping: [instance] TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** Monday 24 November 2025 08:46:50 +0000 (0:00:00.036) 0:04:44.563 ******* ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': 'd041abc1-1d17-4a9d-abec-87dc9325eae8'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '23f673a9-2b71-4776-b3e2-918f0cf96dd7'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': 'acfd06c8-8443-49e0-9882-aac2a7d81caa'}) TASK [reproducer : Output baremetal info file] ********************************* Monday 24 November 2025 08:46:51 +0000 (0:00:00.132) 0:04:44.696 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Output ironic_nodes to file] ******************************** Monday 24 November 2025 08:46:52 +0000 (0:00:01.012) 0:04:45.709 ******* skipping: [instance] TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* Monday 24 November 2025 08:46:52 +0000 (0:00:00.039) 0:04:45.748 ******* TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** Monday 24 November 2025 08:46:52 +0000 (0:00:00.137) 0:04:45.886 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Monday 24 November 2025 08:46:52 +0000 (0:00:00.048) 0:04:45.934 ******* skipping: [instance] TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Monday 24 November 2025 08:46:52 +0000 (0:00:00.044) 0:04:45.978 ******* skipping: [instance] TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** Monday 24 November 2025 08:46:52 +0000 (0:00:00.036) 0:04:46.015 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** Monday 24 November 2025 08:46:53 +0000 (0:00:01.340) 0:04:47.355 ******* ok: [instance -> controller-0(controller-0.instance)] => (item=d041abc1-1d17-4a9d-abec-87dc9325eae8) ok: [instance -> controller-0(controller-0.instance)] => (item=23f673a9-2b71-4776-b3e2-918f0cf96dd7) ok: [instance -> controller-0(controller-0.instance)] => (item=acfd06c8-8443-49e0-9882-aac2a7d81caa) TASK [sushy_emulator : Verify baremetal VM power status] *********************** Monday 24 November 2025 08:46:58 +0000 (0:00:04.624) 0:04:51.980 ******* ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** Monday 24 November 2025 08:46:58 +0000 (0:00:00.099) 0:04:52.079 ******* ok: [instance -> localhost] TASK [reproducer : Sync local repositories to other hosts if present] ********** Monday 24 November 2025 08:46:58 +0000 (0:00:00.208) 0:04:52.288 ******* changed: [instance -> localhost] => (item=controller-0) TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** Monday 24 November 2025 08:47:01 +0000 (0:00:02.341) 0:04:54.629 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install ansible dependencies] ******************************* Monday 24 November 2025 08:47:01 +0000 (0:00:00.674) 0:04:55.304 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** Monday 24 November 2025 08:47:02 +0000 (0:00:00.765) 0:04:56.069 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** Monday 24 November 2025 08:47:03 +0000 (0:00:01.112) 0:04:57.182 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject local environment parameters] ************************ Monday 24 November 2025 08:47:04 +0000 (0:00:00.702) 0:04:57.884 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create openshift-environment.yml symlink to old location] *** Monday 24 November 2025 08:47:05 +0000 (0:00:01.031) 0:04:58.916 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get interfaces-info content] ******************************** Monday 24 November 2025 08:47:05 +0000 (0:00:00.621) 0:04:59.537 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Wait for OCP nodes to be ready] ***************************** Monday 24 November 2025 08:47:06 +0000 (0:00:00.601) 0:05:00.138 ******* ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) TASK [networking_mapper : Check for Networking Definition file existence] ****** Monday 24 November 2025 08:47:07 +0000 (0:00:01.337) 0:05:01.475 ******* skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Monday 24 November 2025 08:47:07 +0000 (0:00:00.035) 0:05:01.510 ******* skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Monday 24 November 2025 08:47:07 +0000 (0:00:00.036) 0:05:01.547 ******* skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Monday 24 November 2025 08:47:08 +0000 (0:00:00.045) 0:05:01.592 ******* skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Monday 24 November 2025 08:47:08 +0000 (0:00:00.034) 0:05:01.626 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Monday 24 November 2025 08:47:08 +0000 (0:00:00.036) 0:05:01.662 ******* ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) ok: [instance -> controller-0(controller-0.instance)] => (item={}) TASK [networking_mapper : Gather facts if requested] *************************** Monday 24 November 2025 08:47:08 +0000 (0:00:00.106) 0:05:01.769 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance TASK [networking_mapper : Gather the facts] ************************************ Monday 24 November 2025 08:47:08 +0000 (0:00:00.049) 0:05:01.819 ******* ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** Monday 24 November 2025 08:47:11 +0000 (0:00:03.382) 0:05:05.201 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Monday 24 November 2025 08:47:12 +0000 (0:00:01.058) 0:05:06.260 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Definition to file] ************* Monday 24 November 2025 08:47:13 +0000 (0:00:00.539) 0:05:06.799 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Call the networking mapper] ************************** Monday 24 November 2025 08:47:14 +0000 (0:00:01.051) 0:05:07.850 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set networking mapper facts] ************************* Monday 24 November 2025 08:47:14 +0000 (0:00:00.079) 0:05:07.930 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Monday 24 November 2025 08:47:14 +0000 (0:00:00.054) 0:05:07.984 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CRC ssh key] ***************************************** Monday 24 November 2025 08:47:15 +0000 (0:00:00.985) 0:05:08.969 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure we have all dependencies installed] ****************** Monday 24 November 2025 08:47:16 +0000 (0:00:00.963) 0:05:09.933 ******* FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [Configure ntp service] *************************************************** Monday 24 November 2025 08:47:22 +0000 (0:00:05.937) 0:05:15.870 ******* TASK [cifmw_ntp : Install chrony] ********************************************** Monday 24 November 2025 08:47:22 +0000 (0:00:00.222) 0:05:16.093 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Configure original chrony.conf file] ************************* Monday 24 November 2025 08:47:23 +0000 (0:00:00.908) 0:05:17.001 ******* ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) TASK [cifmw_ntp : Render chrony extra config file] ***************************** Monday 24 November 2025 08:47:24 +0000 (0:00:00.953) 0:05:17.954 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Enable chrony service] *************************************** Monday 24 November 2025 08:47:25 +0000 (0:00:00.891) 0:05:18.845 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Configure CRC node if available] **************************** Monday 24 November 2025 08:47:25 +0000 (0:00:00.626) 0:05:19.472 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance TASK [reproducer : Get the networking-environment-definition from controller-0] *** Monday 24 November 2025 08:47:26 +0000 (0:00:00.141) 0:05:19.613 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check which dnsmasq config we must edit] ******************** Monday 24 November 2025 08:47:26 +0000 (0:00:00.488) 0:05:20.101 ******* ok: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Configure local DNS for CRC pod] **************************** Monday 24 November 2025 08:47:26 +0000 (0:00:00.452) 0:05:20.553 ******* changed: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** Monday 24 November 2025 08:47:27 +0000 (0:00:00.634) 0:05:21.187 ******* changed: [instance -> crc-0(crc-0.instance)] TASK [Restart DNS in CRC VM] *************************************************** Monday 24 November 2025 08:47:28 +0000 (0:00:00.497) 0:05:21.685 ******* TASK [openshift_setup : Check which dnsmasq config we must edit] *************** Monday 24 November 2025 08:47:28 +0000 (0:00:00.046) 0:05:21.732 ******* ok: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Restart dnsmasq service if used] *********************** Monday 24 November 2025 08:47:28 +0000 (0:00:00.445) 0:05:22.177 ******* changed: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Stop dnsmasq] ****************************************** Monday 24 November 2025 08:47:29 +0000 (0:00:00.721) 0:05:22.899 ******* skipping: [instance] TASK [openshift_setup : Start dnsmasq] ***************************************** Monday 24 November 2025 08:47:29 +0000 (0:00:00.025) 0:05:22.925 ******* skipping: [instance] TASK [reproducer : Remove entry from /etc/hosts] ******************************* Monday 24 November 2025 08:47:29 +0000 (0:00:00.031) 0:05:22.957 ******* changed: [instance] TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** Monday 24 November 2025 08:47:29 +0000 (0:00:00.209) 0:05:23.166 ******* skipping: [instance] => (item=) TASK [dnsmasq : Assert we have needed address data] **************************** Monday 24 November 2025 08:47:29 +0000 (0:00:00.071) 0:05:23.237 ******* ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Monday 24 November 2025 08:47:29 +0000 (0:00:00.032) 0:05:23.270 ******* ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Monday 24 November 2025 08:47:29 +0000 (0:00:00.073) 0:05:23.343 ******* changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ Monday 24 November 2025 08:47:30 +0000 (0:00:00.234) 0:05:23.577 ******* TASK [dnsmasq : Assert we have needed host record data] ************************ Monday 24 November 2025 08:47:30 +0000 (0:00:00.047) 0:05:23.625 ******* ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Monday 24 November 2025 08:47:30 +0000 (0:00:00.058) 0:05:23.683 ******* ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Monday 24 November 2025 08:47:30 +0000 (0:00:00.054) 0:05:23.737 ******* changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [reproducer : Ensure "testing" domain is "local"] ************************* Monday 24 November 2025 08:47:30 +0000 (0:00:00.255) 0:05:23.993 ******* changed: [instance] TASK [reproducer : Flush handlers] ********************************************* Monday 24 November 2025 08:47:30 +0000 (0:00:00.400) 0:05:24.394 ******* RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** Monday 24 November 2025 08:47:30 +0000 (0:00:00.015) 0:05:24.409 ******* changed: [instance -> controller-0(controller-0.instance)] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Monday 24 November 2025 08:47:31 +0000 (0:00:00.663) 0:05:25.073 ******* changed: [instance] TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** Monday 24 November 2025 08:47:31 +0000 (0:00:00.366) 0:05:25.440 ******* skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** Monday 24 November 2025 08:47:32 +0000 (0:00:00.166) 0:05:25.606 ******* changed: [instance -> compute-0(compute-0.instance)] TASK [reproducer : Tweak dnf configuration] ************************************ Monday 24 November 2025 08:47:33 +0000 (0:00:01.464) 0:05:27.070 ******* skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Monday 24 November 2025 08:47:33 +0000 (0:00:00.019) 0:05:27.090 ******* ok: [instance -> compute-0(compute-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Monday 24 November 2025 08:47:33 +0000 (0:00:00.461) 0:05:27.551 ******* skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Monday 24 November 2025 08:47:34 +0000 (0:00:00.032) 0:05:27.583 ******* skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Monday 24 November 2025 08:47:34 +0000 (0:00:00.033) 0:05:27.617 ******* skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Monday 24 November 2025 08:47:34 +0000 (0:00:00.033) 0:05:27.650 ******* changed: [instance -> compute-0(compute-0.instance)] TASK [reproducer : Get rhos-release and setup repos] *************************** Monday 24 November 2025 08:47:35 +0000 (0:00:01.444) 0:05:29.094 ******* skipping: [instance] TASK [reproducer : Create repositories on computes] **************************** Monday 24 November 2025 08:47:35 +0000 (0:00:00.035) 0:05:29.130 ******* skipping: [instance] TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* Monday 24 November 2025 08:47:35 +0000 (0:00:00.019) 0:05:29.149 ******* skipping: [instance] TASK [reproducer : Discover and expose CI Framework path on remote node] ******* Monday 24 November 2025 08:47:35 +0000 (0:00:00.029) 0:05:29.179 ******* ok: [instance] TASK [reproducer : Push local code] ******************************************** Monday 24 November 2025 08:47:35 +0000 (0:00:00.054) 0:05:29.233 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance TASK [reproducer : Check if repository directories already exist] ************** Monday 24 November 2025 08:47:35 +0000 (0:00:00.097) 0:05:29.331 ******* skipping: [instance] TASK [reproducer : Ensure we are not in the job_id branch] ********************* Monday 24 November 2025 08:47:35 +0000 (0:00:00.039) 0:05:29.370 ******* skipping: [instance] TASK [reproducer : Fetch zuul.items repositories] ****************************** Monday 24 November 2025 08:47:35 +0000 (0:00:00.037) 0:05:29.408 ******* skipping: [instance] TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** Monday 24 November 2025 08:47:35 +0000 (0:00:00.037) 0:05:29.446 ******* skipping: [instance] TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** Monday 24 November 2025 08:47:35 +0000 (0:00:00.036) 0:05:29.482 ******* skipping: [instance] TASK [reproducer : Create target directories beforehand] *********************** Monday 24 November 2025 08:47:35 +0000 (0:00:00.037) 0:05:29.520 ******* ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) TASK [reproducer : Sync local repositories to ansible controller] ************** Monday 24 November 2025 08:47:36 +0000 (0:00:00.446) 0:05:29.966 ******* ok: [instance -> localhost] => (item=ci-framework) TASK [reproducer : Sync remote repositories] *********************************** Monday 24 November 2025 08:47:36 +0000 (0:00:00.554) 0:05:30.521 ******* skipping: [instance] => (item=ci-framework) skipping: [instance] TASK [reproducer : Ensure default repositories are present] ******************** Monday 24 November 2025 08:47:36 +0000 (0:00:00.039) 0:05:30.561 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) TASK [reproducer : Check repository availability: ci-framework] **************** Monday 24 November 2025 08:47:37 +0000 (0:00:00.074) 0:05:30.636 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: ci-framework] ******************* Monday 24 November 2025 08:47:37 +0000 (0:00:00.441) 0:05:31.077 ******* skipping: [instance] TASK [reproducer : Check repository availability: install_yamls] *************** Monday 24 November 2025 08:47:37 +0000 (0:00:00.035) 0:05:31.113 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: install_yamls] ****************** Monday 24 November 2025 08:47:38 +0000 (0:00:00.461) 0:05:31.575 ******* skipping: [instance] TASK [reproducer : Check repository availability: architecture] **************** Monday 24 November 2025 08:47:38 +0000 (0:00:00.037) 0:05:31.612 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: architecture] ******************* Monday 24 November 2025 08:47:38 +0000 (0:00:00.433) 0:05:32.045 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install collections on controller-0] ************************ Monday 24 November 2025 08:47:40 +0000 (0:00:02.238) 0:05:34.284 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CI Framework motd] *********************************** Monday 24 November 2025 08:48:00 +0000 (0:00:19.398) 0:05:53.682 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate some logs] ******************************************* Monday 24 November 2025 08:48:01 +0000 (0:00:00.983) 0:05:54.665 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* Monday 24 November 2025 08:48:01 +0000 (0:00:00.098) 0:05:54.764 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate log if present] ************************************** Monday 24 November 2025 08:48:01 +0000 (0:00:00.427) 0:05:55.191 ******* skipping: [instance] TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** Monday 24 November 2025 08:48:01 +0000 (0:00:00.035) 0:05:55.226 ******* skipping: [instance] TASK [cifmw_setup : Get customized parameters] ********************************* Monday 24 November 2025 08:48:01 +0000 (0:00:00.042) 0:05:55.269 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Ensure target directory exists] ***************************** Monday 24 November 2025 08:48:01 +0000 (0:00:00.093) 0:05:55.362 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Monday 24 November 2025 08:48:02 +0000 (0:00:00.479) 0:05:55.842 ******* skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Monday 24 November 2025 08:48:02 +0000 (0:00:00.037) 0:05:55.880 ******* skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Monday 24 November 2025 08:48:02 +0000 (0:00:00.039) 0:05:55.919 ******* skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Monday 24 November 2025 08:48:02 +0000 (0:00:00.038) 0:05:55.958 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Ensure directories are present] ***************************** Monday 24 November 2025 08:48:03 +0000 (0:00:01.474) 0:05:57.433 ******* changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [repo_setup : Make sure git-core package is installed] ******************** Monday 24 November 2025 08:48:05 +0000 (0:00:01.378) 0:05:58.811 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Get repo-setup repository] ********************************** Monday 24 November 2025 08:48:06 +0000 (0:00:00.917) 0:05:59.728 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Initialize python venv and install requirements] ************ Monday 24 November 2025 08:48:07 +0000 (0:00:01.202) 0:06:00.931 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Install repo-setup package] ********************************* Monday 24 November 2025 08:48:15 +0000 (0:00:07.709) 0:06:08.640 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Monday 24 November 2025 08:48:16 +0000 (0:00:00.925) 0:06:09.566 ******* skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Monday 24 November 2025 08:48:16 +0000 (0:00:00.036) 0:06:09.603 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Get component repo] ***************************************** Monday 24 November 2025 08:48:17 +0000 (0:00:01.080) 0:06:10.683 ******* skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Monday 24 November 2025 08:48:17 +0000 (0:00:00.052) 0:06:10.736 ******* skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Monday 24 November 2025 08:48:17 +0000 (0:00:00.051) 0:06:10.787 ******* skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Monday 24 November 2025 08:48:17 +0000 (0:00:00.052) 0:06:10.839 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Monday 24 November 2025 08:48:18 +0000 (0:00:00.807) 0:06:11.647 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Dump current-podified hash] ********************************* Monday 24 November 2025 08:48:18 +0000 (0:00:00.879) 0:06:12.527 ******* skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Monday 24 November 2025 08:48:19 +0000 (0:00:00.101) 0:06:12.628 ******* skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Monday 24 November 2025 08:48:19 +0000 (0:00:00.042) 0:06:12.670 ******* skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Monday 24 November 2025 08:48:19 +0000 (0:00:00.042) 0:06:12.713 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Create download directory] ********************************** Monday 24 November 2025 08:48:19 +0000 (0:00:00.057) 0:06:12.771 ******* skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Monday 24 November 2025 08:48:19 +0000 (0:00:00.042) 0:06:12.813 ******* skipping: [instance] TASK [Download the RPM] ******************************************************** Monday 24 November 2025 08:48:19 +0000 (0:00:00.038) 0:06:12.852 ******* skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Monday 24 November 2025 08:48:19 +0000 (0:00:00.041) 0:06:12.893 ******* skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Monday 24 November 2025 08:48:19 +0000 (0:00:00.040) 0:06:12.933 ******* skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Monday 24 November 2025 08:48:19 +0000 (0:00:00.041) 0:06:12.975 ******* skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Monday 24 November 2025 08:48:19 +0000 (0:00:00.040) 0:06:13.016 ******* skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Monday 24 November 2025 08:48:19 +0000 (0:00:00.041) 0:06:13.057 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Monday 24 November 2025 08:48:19 +0000 (0:00:00.474) 0:06:13.532 ******* skipping: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Monday 24 November 2025 08:48:20 +0000 (0:00:00.051) 0:06:13.584 ******* skipping: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Monday 24 November 2025 08:48:20 +0000 (0:00:00.051) 0:06:13.635 ******* skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Monday 24 November 2025 08:48:20 +0000 (0:00:00.039) 0:06:13.675 ******* skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Monday 24 November 2025 08:48:20 +0000 (0:00:00.052) 0:06:13.727 ******* skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Monday 24 November 2025 08:48:20 +0000 (0:00:00.053) 0:06:13.781 ******* skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Monday 24 November 2025 08:48:20 +0000 (0:00:00.054) 0:06:13.836 ******* skipping: [instance] TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** Monday 24 November 2025 08:48:20 +0000 (0:00:00.053) 0:06:13.889 ******* skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Monday 24 November 2025 08:48:20 +0000 (0:00:00.052) 0:06:13.942 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Monday 24 November 2025 08:48:21 +0000 (0:00:00.646) 0:06:14.588 ******* changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [repo_setup : Cleanup existing metadata] ********************************** Monday 24 November 2025 08:48:21 +0000 (0:00:00.949) 0:06:15.537 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Monday 24 November 2025 08:48:22 +0000 (0:00:00.701) 0:06:16.238 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Gather variables for each operating system] ******************* Monday 24 November 2025 08:48:23 +0000 (0:00:00.489) 0:06:16.728 ******* ok: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0] TASK [ci_setup : List packages to install] ************************************* Monday 24 November 2025 08:48:23 +0000 (0:00:00.060) 0:06:16.789 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Install needed packages] ************************************** Monday 24 November 2025 08:48:23 +0000 (0:00:00.041) 0:06:16.830 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Gather version of openshift client] *************************** Monday 24 November 2025 08:48:53 +0000 (0:00:30.213) 0:06:47.043 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Ensure openshift client install path is present] ************** Monday 24 November 2025 08:48:53 +0000 (0:00:00.463) 0:06:47.507 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Install openshift client] ************************************* Monday 24 November 2025 08:48:54 +0000 (0:00:00.466) 0:06:47.974 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** Monday 24 November 2025 08:49:00 +0000 (0:00:05.875) 0:06:53.849 ******* skipping: [instance] TASK [ci_setup : Create completion file] *************************************** Monday 24 November 2025 08:49:00 +0000 (0:00:00.048) 0:06:53.898 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Source completion from within .bashrc] ************************ Monday 24 November 2025 08:49:00 +0000 (0:00:00.565) 0:06:54.464 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Check rhsm status] ******************************************** Monday 24 November 2025 08:49:01 +0000 (0:00:00.451) 0:06:54.915 ******* skipping: [instance] TASK [ci_setup : Gather the repos to be enabled] ******************************* Monday 24 November 2025 08:49:01 +0000 (0:00:00.037) 0:06:54.953 ******* skipping: [instance] TASK [ci_setup : Enabling the required repositories.] ************************** Monday 24 November 2025 08:49:01 +0000 (0:00:00.039) 0:06:54.992 ******* skipping: [instance] TASK [ci_setup : Get current /etc/redhat-release] ****************************** Monday 24 November 2025 08:49:01 +0000 (0:00:00.038) 0:06:55.030 ******* skipping: [instance] TASK [ci_setup : Print current /etc/redhat-release] **************************** Monday 24 November 2025 08:49:01 +0000 (0:00:00.037) 0:06:55.068 ******* skipping: [instance] TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* Monday 24 November 2025 08:49:01 +0000 (0:00:00.038) 0:06:55.107 ******* skipping: [instance] TASK [ci_setup : Manage directories] ******************************************* Monday 24 November 2025 08:49:01 +0000 (0:00:00.038) 0:06:55.145 ******* changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [Prepare install_yamls make targets] ************************************** Monday 24 November 2025 08:49:04 +0000 (0:00:02.461) 0:06:57.606 ******* TASK [install_yamls : Ensure directories exist] ******************************** Monday 24 November 2025 08:49:04 +0000 (0:00:00.154) 0:06:57.760 ******* ok: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [Create variables with local repos based on Zuul items] ******************* Monday 24 November 2025 08:49:05 +0000 (0:00:01.409) 0:06:59.170 ******* TASK [install_yamls : Set fact with local repos based on Zuul items] *********** Monday 24 November 2025 08:49:05 +0000 (0:00:00.062) 0:06:59.232 ******* skipping: [instance] TASK [install_yamls : Print helpful data for debugging] ************************ Monday 24 November 2025 08:49:05 +0000 (0:00:00.043) 0:06:59.275 ******* skipping: [instance] TASK [Customize install_yamls devsetup vars if needed] ************************* Monday 24 November 2025 08:49:05 +0000 (0:00:00.048) 0:06:59.324 ******* TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** Monday 24 November 2025 08:49:05 +0000 (0:00:00.063) 0:06:59.387 ******* skipping: [instance] TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** Monday 24 November 2025 08:49:05 +0000 (0:00:00.039) 0:06:59.427 ******* skipping: [instance] TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** Monday 24 November 2025 08:49:05 +0000 (0:00:00.037) 0:06:59.465 ******* skipping: [instance] TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** Monday 24 November 2025 08:49:05 +0000 (0:00:00.040) 0:06:59.505 ******* skipping: [instance] TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** Monday 24 November 2025 08:49:05 +0000 (0:00:00.044) 0:06:59.550 ******* ok: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0] TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** Monday 24 November 2025 08:49:06 +0000 (0:00:00.146) 0:06:59.696 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Get environment structure] ******************************* Monday 24 November 2025 08:49:06 +0000 (0:00:00.065) 0:06:59.762 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Ensure Output directory exists] ************************** Monday 24 November 2025 08:49:07 +0000 (0:00:00.955) 0:07:00.717 ******* skipping: [instance] TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** Monday 24 November 2025 08:49:07 +0000 (0:00:00.037) 0:07:00.755 ******* skipping: [instance] TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** Monday 24 November 2025 08:49:07 +0000 (0:00:00.046) 0:07:00.802 ******* skipping: [instance] TASK [install_yamls : Set install_yamls default values] ************************ Monday 24 November 2025 08:49:07 +0000 (0:00:00.039) 0:07:00.841 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Show the env structure] ********************************** Monday 24 November 2025 08:49:07 +0000 (0:00:00.063) 0:07:00.905 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Show the env structure defaults] ************************* Monday 24 November 2025 08:49:07 +0000 (0:00:00.045) 0:07:00.950 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Generate make targets] *********************************** Monday 24 November 2025 08:49:07 +0000 (0:00:00.053) 0:07:01.004 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Debug generate_make module] ****************************** Monday 24 November 2025 08:49:08 +0000 (0:00:00.565) 0:07:01.569 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Create the install_yamls parameters file] **************** Monday 24 November 2025 08:49:08 +0000 (0:00:00.048) 0:07:01.618 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** Monday 24 November 2025 08:49:08 +0000 (0:00:00.883) 0:07:02.501 ******* skipping: [instance] TASK [discover_latest_image : Get latest image] ******************************** Monday 24 November 2025 08:49:08 +0000 (0:00:00.044) 0:07:02.546 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [discover_latest_image : Export facts accordingly] ************************ Monday 24 November 2025 08:49:09 +0000 (0:00:00.763) 0:07:03.310 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [cifmw_setup : Create artifacts with custom params] *********************** Monday 24 November 2025 08:49:09 +0000 (0:00:00.050) 0:07:03.360 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* Monday 24 November 2025 08:49:10 +0000 (0:00:00.879) 0:07:04.239 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [Configure CRC network if needed] ***************************************** Monday 24 November 2025 08:49:11 +0000 (0:00:00.458) 0:07:04.698 ******* TASK [openshift_setup : Gather network.operator info] ************************** Monday 24 November 2025 08:49:11 +0000 (0:00:00.147) 0:07:04.846 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [openshift_setup : Patch network operator] ******************************** Monday 24 November 2025 08:49:12 +0000 (0:00:01.134) 0:07:05.981 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [Ensure OCP cluster is stable] ******************************************** Monday 24 November 2025 08:49:13 +0000 (0:00:01.149) 0:07:07.130 ******* skipping: [instance] TASK [reproducer : Emulate CI job] ********************************************* Monday 24 November 2025 08:49:13 +0000 (0:00:00.027) 0:07:07.157 ******* skipping: [instance] TASK [reproducer : Prepare architecture-based deployment] ********************** Monday 24 November 2025 08:49:13 +0000 (0:00:00.036) 0:07:07.194 ******* skipping: [instance] TASK [reproducer : Prepare architecture-based post deployment] ***************** Monday 24 November 2025 08:49:13 +0000 (0:00:00.034) 0:07:07.228 ******* skipping: [instance] TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** Monday 24 November 2025 08:49:13 +0000 (0:00:00.034) 0:07:07.263 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** Monday 24 November 2025 08:49:14 +0000 (0:00:00.915) 0:07:08.178 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [Ensure we have needed inventory files] *********************************** Monday 24 November 2025 08:49:15 +0000 (0:00:00.434) 0:07:08.613 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [Ensure we have CRC ssh key] ********************************************** Monday 24 November 2025 08:49:15 +0000 (0:00:00.438) 0:07:09.051 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [Ensure we have the MAC mapping file] ************************************* Monday 24 November 2025 08:49:15 +0000 (0:00:00.457) 0:07:09.508 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [Load crc inventory] ****************************************************** Monday 24 November 2025 08:49:16 +0000 (0:00:00.465) 0:07:09.973 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [Load compute inventory] ************************************************** Monday 24 November 2025 08:49:16 +0000 (0:00:00.431) 0:07:10.404 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** Monday 24 November 2025 08:49:17 +0000 (0:00:00.419) 0:07:10.824 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* Monday 24 November 2025 08:49:17 +0000 (0:00:00.454) 0:07:11.278 ******* changed: [instance -> controller-0(controller-0.instance)] TASK [Check default location secret file] ************************************** Monday 24 November 2025 08:49:18 +0000 (0:00:00.450) 0:07:11.729 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [Check non-default location secret] *************************************** Monday 24 November 2025 08:49:18 +0000 (0:00:00.454) 0:07:12.184 ******* ok: [instance -> controller-0(controller-0.instance)] TASK [Assert all of the tests] ************************************************* Monday 24 November 2025 08:49:19 +0000 (0:00:00.475) 0:07:12.660 ******* ok: [instance] TASK [Create dnsmasq dir] ****************************************************** Monday 24 November 2025 08:49:19 +0000 (0:00:00.037) 0:07:12.697 ******* changed: [instance] TASK [Get journalctl in a file] ************************************************ Monday 24 November 2025 08:49:19 +0000 (0:00:00.195) 0:07:12.892 ******* changed: [instance] TASK [Dump journalctl output] ************************************************** Monday 24 November 2025 08:49:19 +0000 (0:00:00.219) 0:07:13.111 ******* changed: [instance] TASK [Copy all dnsmasq config] ************************************************* Monday 24 November 2025 08:49:19 +0000 (0:00:00.388) 0:07:13.500 ******* changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) TASK [Create log directory] **************************************************** Monday 24 November 2025 08:49:20 +0000 (0:00:00.489) 0:07:13.990 ******* changed: [instance] TASK [Sync logs from controller-0] ********************************************* Monday 24 November 2025 08:49:20 +0000 (0:00:00.200) 0:07:14.190 ******* changed: [instance] PLAY RECAP ********************************************************************* instance : ok=540 changed=203 unreachable=0 failed=0 skipped=226 rescued=0 ignored=0 Monday 24 November 2025 08:49:21 +0000 (0:00:00.874) 0:07:15.065 ******* =============================================================================== reproducer : Check package install status ------------------------------ 61.09s ci_setup : Install needed packages ------------------------------------- 30.21s libvirt_manager : Download base image ---------------------------------- 21.15s libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.81s reproducer : Install collections on controller-0 ----------------------- 19.40s libvirt_manager : Install packages required for using KVM -------------- 16.20s sushy_emulator : Pull Sushy Emulator container image ------------------- 10.22s repo_setup : Initialize python venv and install requirements ------------ 7.71s ci_nmstate : Install required packages on localhost --------------------- 7.67s reproducer : Ensure we have all dependencies installed ------------------ 5.94s ci_setup : Install openshift client ------------------------------------- 5.88s sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 4.62s dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.73s networking_mapper : Gather the facts ------------------------------------ 3.38s dnsmasq : Add/Remove address -------------------------------------------- 3.27s sushy_emulator : Install required packages ------------------------------ 2.56s ci_setup : Manage directories ------------------------------------------- 2.46s reproducer : Sync local repositories to other hosts if present ---------- 2.34s reproducer : Clone repository if needed: architecture ------------------- 2.24s dnsmasq : Add DHCP entries ---------------------------------------------- 2.07s PLAY [Prepare] ***************************************************************** TASK [Call task file in loop] ************************************************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.033) 0:00:00.033 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** Monday 24 November 2025 08:49:22 +0000 (0:00:00.072) 0:00:00.106 ******* TASK [reproducer : Apply regex match filter] *********************************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.042) 0:00:00.148 ******* ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.035) 0:00:00.183 ******* ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Monday 24 November 2025 08:49:22 +0000 (0:00:00.038) 0:00:00.221 ******* ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.045) 0:00:00.267 ******* skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.024) 0:00:00.292 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** Monday 24 November 2025 08:49:22 +0000 (0:00:00.051) 0:00:00.344 ******* TASK [reproducer : Apply regex match filter] *********************************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.036) 0:00:00.380 ******* ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.033) 0:00:00.414 ******* ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Monday 24 November 2025 08:49:22 +0000 (0:00:00.038) 0:00:00.452 ******* ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.033) 0:00:00.485 ******* skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.030) 0:00:00.516 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** Monday 24 November 2025 08:49:22 +0000 (0:00:00.035) 0:00:00.552 ******* TASK [reproducer : Apply regex match filter] *********************************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.036) 0:00:00.588 ******* ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.034) 0:00:00.622 ******* ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Monday 24 November 2025 08:49:22 +0000 (0:00:00.036) 0:00:00.659 ******* ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.033) 0:00:00.692 ******* skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.023) 0:00:00.716 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** Monday 24 November 2025 08:49:22 +0000 (0:00:00.034) 0:00:00.750 ******* TASK [reproducer : Apply regex match filter] *********************************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.035) 0:00:00.786 ******* ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.034) 0:00:00.820 ******* ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Monday 24 November 2025 08:49:22 +0000 (0:00:00.038) 0:00:00.859 ******* ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.035) 0:00:00.895 ******* skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Monday 24 November 2025 08:49:22 +0000 (0:00:00.028) 0:00:00.924 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** Monday 24 November 2025 08:49:23 +0000 (0:00:00.036) 0:00:00.960 ******* TASK [reproducer : Apply regex match filter] *********************************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.056) 0:00:01.017 ******* ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.032) 0:00:01.050 ******* fatal: [instance]: FAILED! => changed=false assertion: _matched_url | default('') | length > 0 evaluated_to: false msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' TASK [Clear errors to manually handle them] ************************************ Monday 24 November 2025 08:49:23 +0000 (0:00:00.035) 0:00:01.085 ******* TASK [Really fail if string passed but should have failed] ********************* Monday 24 November 2025 08:49:23 +0000 (0:00:00.016) 0:00:01.102 ******* skipping: [instance] TASK [Really fail if string failed but should have passed] ********************* Monday 24 November 2025 08:49:23 +0000 (0:00:00.032) 0:00:01.134 ******* skipping: [instance] TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.168 ******* TASK [reproducer : Apply regex match filter] *********************************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.036) 0:00:01.204 ******* ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.238 ******* fatal: [instance]: FAILED! => changed=false assertion: _matched_url | default('') | length > 0 evaluated_to: false msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' TASK [Clear errors to manually handle them] ************************************ Monday 24 November 2025 08:49:23 +0000 (0:00:00.040) 0:00:01.278 ******* TASK [Really fail if string passed but should have failed] ********************* Monday 24 November 2025 08:49:23 +0000 (0:00:00.016) 0:00:01.294 ******* skipping: [instance] TASK [Really fail if string failed but should have passed] ********************* Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.327 ******* skipping: [instance] TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.361 ******* TASK [reproducer : Apply regex match filter] *********************************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.042) 0:00:01.403 ******* ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.036) 0:00:01.439 ******* ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Monday 24 November 2025 08:49:23 +0000 (0:00:00.037) 0:00:01.477 ******* ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.035) 0:00:01.512 ******* skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.026) 0:00:01.539 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** Monday 24 November 2025 08:49:23 +0000 (0:00:00.037) 0:00:01.576 ******* TASK [reproducer : Apply regex match filter] *********************************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.060) 0:00:01.637 ******* ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.670 ******* ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Monday 24 November 2025 08:49:23 +0000 (0:00:00.036) 0:00:01.707 ******* ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.037) 0:00:01.744 ******* skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.026) 0:00:01.771 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** Monday 24 November 2025 08:49:23 +0000 (0:00:00.034) 0:00:01.805 ******* TASK [reproducer : Apply regex match filter] *********************************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.036) 0:00:01.842 ******* ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.875 ******* fatal: [instance]: FAILED! => changed=false assertion: _matched_url | default('') | length > 0 evaluated_to: false msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' TASK [Clear errors to manually handle them] ************************************ Monday 24 November 2025 08:49:23 +0000 (0:00:00.038) 0:00:01.914 ******* TASK [Really fail if string passed but should have failed] ********************* Monday 24 November 2025 08:49:23 +0000 (0:00:00.016) 0:00:01.930 ******* skipping: [instance] TASK [Really fail if string failed but should have passed] ********************* Monday 24 November 2025 08:49:24 +0000 (0:00:00.033) 0:00:01.964 ******* skipping: [instance] TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** Monday 24 November 2025 08:49:24 +0000 (0:00:00.033) 0:00:01.998 ******* TASK [reproducer : Apply regex match filter] *********************************** Monday 24 November 2025 08:49:24 +0000 (0:00:00.035) 0:00:02.033 ******* ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Monday 24 November 2025 08:49:24 +0000 (0:00:00.032) 0:00:02.065 ******* fatal: [instance]: FAILED! => changed=false assertion: _matched_url | default('') | length > 0 evaluated_to: false msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' TASK [Clear errors to manually handle them] ************************************ Monday 24 November 2025 08:49:24 +0000 (0:00:00.035) 0:00:02.101 ******* TASK [Really fail if string passed but should have failed] ********************* Monday 24 November 2025 08:49:24 +0000 (0:00:00.016) 0:00:02.118 ******* skipping: [instance] TASK [Really fail if string failed but should have passed] ********************* Monday 24 November 2025 08:49:24 +0000 (0:00:00.033) 0:00:02.151 ******* skipping: [instance] TASK [Print success message] *************************************************** Monday 24 November 2025 08:49:24 +0000 (0:00:00.033) 0:00:02.185 ******* ok: [instance] => msg: All strings passed! PLAY RECAP ********************************************************************* instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 Monday 24 November 2025 08:49:24 +0000 (0:00:00.073) 0:00:02.258 ******* =============================================================================== Print success message --------------------------------------------------- 0.07s Call task file in loop -------------------------------------------------- 0.07s Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.06s Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.06s Fail if string incorrectly passed when defined not to pass -------------- 0.05s reproducer : Extract job id for later reference ------------------------- 0.05s Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log --- 0.04s Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything///// --- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s reproducer : Extract job id for later reference ------------------------- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s Fail if string incorrectly passed when defined not to pass -------------- 0.04s Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7 --- 0.04s Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 --- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s reproducer : Apply regex match filter ----------------------------------- 0.04s PLAY [Prepare] ***************************************************************** TASK [Set failed fact] ********************************************************* Monday 24 November 2025 08:49:24 +0000 (0:00:00.033) 0:00:00.033 ******* ok: [instance] TASK [Load scenarios] ********************************************************** Monday 24 November 2025 08:49:24 +0000 (0:00:00.021) 0:00:00.054 ******* ok: [instance] TASK [Test network validations] ************************************************ Monday 24 November 2025 08:49:24 +0000 (0:00:00.022) 0:00:00.077 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:24 +0000 (0:00:00.058) 0:00:00.136 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:24 +0000 (0:00:00.021) 0:00:00.157 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:24 +0000 (0:00:00.025) 0:00:00.183 ******* ok: [instance] => msg: 'Running: Default nets only' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.023) 0:00:00.207 ******* TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Monday 24 November 2025 08:49:25 +0000 (0:00:00.041) 0:00:00.248 ******* [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. ok: [instance] => (item=controller) TASK [reproducer : Ensure all standard attached networks are defined] ********** Monday 24 November 2025 08:49:25 +0000 (0:00:00.076) 0:00:00.325 ******* ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.053) 0:00:00.378 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:25 +0000 (0:00:00.063) 0:00:00.441 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.036) 0:00:00.478 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.030) 0:00:00.509 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.033) 0:00:00.542 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.021) 0:00:00.564 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.025) 0:00:00.590 ******* ok: [instance] => msg: 'Running: Default nets and spine/leaf' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.026) 0:00:00.617 ******* TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Monday 24 November 2025 08:49:25 +0000 (0:00:00.038) 0:00:00.656 ******* [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. ok: [instance] => (item=controller) TASK [reproducer : Ensure all standard attached networks are defined] ********** Monday 24 November 2025 08:49:25 +0000 (0:00:00.045) 0:00:00.702 ******* ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.054) 0:00:00.756 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:25 +0000 (0:00:00.063) 0:00:00.820 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.035) 0:00:00.856 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.032) 0:00:00.888 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.031) 0:00:00.919 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.020) 0:00:00.940 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.025) 0:00:00.966 ******* ok: [instance] => msg: 'Running: Default nets with extra defined net' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.024) 0:00:00.990 ******* TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Monday 24 November 2025 08:49:25 +0000 (0:00:00.041) 0:00:01.032 ******* [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. ok: [instance] => (item=controller) TASK [reproducer : Ensure all standard attached networks are defined] ********** Monday 24 November 2025 08:49:25 +0000 (0:00:00.066) 0:00:01.098 ******* ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Monday 24 November 2025 08:49:25 +0000 (0:00:00.055) 0:00:01.153 ******* fatal: [instance]: FAILED! => changed=false assertion: _defined | difference(_all_nets) | length == 0 evaluated_to: false msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' TASK [reproducer : Dump initial layout] **************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.055) 0:00:01.208 ******* ok: [instance] => cifmw_libvirt_manager_configuration: networks: public: defined vms: controller: nets: - public TASK [reproducer : Dump CI reproducer generated layout] ************************ Monday 24 November 2025 08:49:26 +0000 (0:00:00.031) 0:00:01.240 ******* skipping: [instance] TASK [reproducer : Dump layout patches] **************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.030) 0:00:01.270 ******* skipping: [instance] TASK [reproducer : Dump built layout] ****************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.068) 0:00:01.338 ******* ok: [instance] => _cifmw_libvirt_manager_layout: networks: extra_net_1: defined public: defined vms: controller: nets: - public TASK [reproducer : Fail for good] ********************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.037) 0:00:01.376 ******* fatal: [instance]: FAILED! => changed=false msg: Error detected, please check assertions and debugging output above. TASK [Clear host errors] ******************************************************* Monday 24 November 2025 08:49:26 +0000 (0:00:00.022) 0:00:01.398 ******* TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.016) 0:00:01.415 ******* ok: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:26 +0000 (0:00:00.022) 0:00:01.437 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.036) 0:00:01.474 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.030) 0:00:01.504 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.029) 0:00:01.534 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.020) 0:00:01.555 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.022) 0:00:01.577 ******* ok: [instance] => msg: 'Running: Missing default net definition' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.026) 0:00:01.604 ******* TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Monday 24 November 2025 08:49:26 +0000 (0:00:00.042) 0:00:01.647 ******* [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. ok: [instance] => (item=controller) TASK [reproducer : Ensure all standard attached networks are defined] ********** Monday 24 November 2025 08:49:26 +0000 (0:00:00.042) 0:00:01.690 ******* fatal: [instance]: FAILED! => changed=false assertion: _all_nets | difference(_defined) | length == 0 evaluated_to: false msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' TASK [reproducer : Dump initial layout] **************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.054) 0:00:01.745 ******* ok: [instance] => cifmw_libvirt_manager_configuration: networks: public: defined vms: controller: nets: - public TASK [reproducer : Dump CI reproducer generated layout] ************************ Monday 24 November 2025 08:49:26 +0000 (0:00:00.030) 0:00:01.775 ******* skipping: [instance] TASK [reproducer : Dump layout patches] **************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.025) 0:00:01.801 ******* skipping: [instance] TASK [reproducer : Dump built layout] ****************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.093) 0:00:01.895 ******* ok: [instance] => _cifmw_libvirt_manager_layout: networks: public: defined vms: controller: nets: - public - foo TASK [reproducer : Fail for good] ********************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.036) 0:00:01.931 ******* fatal: [instance]: FAILED! => changed=false msg: Error detected, please check assertions and debugging output above. TASK [Clear host errors] ******************************************************* Monday 24 November 2025 08:49:26 +0000 (0:00:00.048) 0:00:01.980 ******* TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.015) 0:00:01.996 ******* ok: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:26 +0000 (0:00:00.019) 0:00:02.016 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.034) 0:00:02.051 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.030) 0:00:02.081 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.030) 0:00:02.112 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.021) 0:00:02.134 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.024) 0:00:02.158 ******* ok: [instance] => msg: 'Running: Missing spine/leaf net definition' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:26 +0000 (0:00:00.024) 0:00:02.183 ******* TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Monday 24 November 2025 08:49:27 +0000 (0:00:00.038) 0:00:02.222 ******* [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. ok: [instance] => (item=controller) TASK [reproducer : Ensure all standard attached networks are defined] ********** Monday 24 November 2025 08:49:27 +0000 (0:00:00.043) 0:00:02.266 ******* fatal: [instance]: FAILED! => changed=false assertion: _all_nets | difference(_defined) | length == 0 evaluated_to: false msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' TASK [reproducer : Dump initial layout] **************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.055) 0:00:02.322 ******* ok: [instance] => cifmw_libvirt_manager_configuration: networks: l00-s0: defined public: defined vms: controller: nets: - public spineleafnets: - l00-s0 TASK [reproducer : Dump CI reproducer generated layout] ************************ Monday 24 November 2025 08:49:27 +0000 (0:00:00.030) 0:00:02.353 ******* skipping: [instance] TASK [reproducer : Dump layout patches] **************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.026) 0:00:02.379 ******* skipping: [instance] TASK [reproducer : Dump built layout] ****************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.067) 0:00:02.446 ******* ok: [instance] => _cifmw_libvirt_manager_layout: networks: l00-s0: defined public: defined vms: controller: nets: - public spineleafnets: - l00-s0 - l00-s1 TASK [reproducer : Fail for good] ********************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.038) 0:00:02.485 ******* fatal: [instance]: FAILED! => changed=false msg: Error detected, please check assertions and debugging output above. TASK [Clear host errors] ******************************************************* Monday 24 November 2025 08:49:27 +0000 (0:00:00.026) 0:00:02.511 ******* TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.015) 0:00:02.527 ******* ok: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:27 +0000 (0:00:00.021) 0:00:02.548 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.035) 0:00:02.583 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.030) 0:00:02.614 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.031) 0:00:02.646 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.045) 0:00:02.691 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.023) 0:00:02.715 ******* ok: [instance] => msg: 'Running: No network for a VM' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.024) 0:00:02.740 ******* TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Monday 24 November 2025 08:49:27 +0000 (0:00:00.038) 0:00:02.779 ******* [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. failed: [instance] (item=foo) => changed=false ansible_loop_var: item assertion: item.value.nets is defined evaluated_to: false item: key: foo value: disksize: 10 msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' ok: [instance] => (item=controller) TASK [reproducer : Dump initial layout] **************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.047) 0:00:02.826 ******* ok: [instance] => cifmw_libvirt_manager_configuration: networks: public: defined vms: controller: nets: - public TASK [reproducer : Dump CI reproducer generated layout] ************************ Monday 24 November 2025 08:49:27 +0000 (0:00:00.032) 0:00:02.858 ******* skipping: [instance] TASK [reproducer : Dump layout patches] **************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.025) 0:00:02.884 ******* skipping: [instance] TASK [reproducer : Dump built layout] ****************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.067) 0:00:02.951 ******* ok: [instance] => _cifmw_libvirt_manager_layout: networks: public: defined vms: controller: nets: - public foo: disksize: 10 TASK [reproducer : Fail for good] ********************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.037) 0:00:02.989 ******* fatal: [instance]: FAILED! => changed=false msg: Error detected, please check assertions and debugging output above. TASK [Clear host errors] ******************************************************* Monday 24 November 2025 08:49:27 +0000 (0:00:00.022) 0:00:03.011 ******* TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.016) 0:00:03.028 ******* ok: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:27 +0000 (0:00:00.021) 0:00:03.049 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.036) 0:00:03.086 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.032) 0:00:03.118 ******* skipping: [instance] TASK [Fail if needed] ********************************************************** Monday 24 November 2025 08:49:27 +0000 (0:00:00.035) 0:00:03.154 ******* skipping: [instance] PLAY RECAP ********************************************************************* instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 Monday 24 November 2025 08:49:28 +0000 (0:00:00.056) 0:00:03.210 ******* =============================================================================== reproducer : Dump layout patches ---------------------------------------- 0.09s reproducer : Ensure all VM types have defined nets parameter ------------ 0.08s reproducer : Dump layout patches ---------------------------------------- 0.07s reproducer : Dump layout patches ---------------------------------------- 0.07s reproducer : Dump layout patches ---------------------------------------- 0.07s reproducer : Ensure all VM types have defined nets parameter ------------ 0.07s reproducer : Ensure we don't have extra network defined ----------------- 0.06s reproducer : Ensure we don't have extra network defined ----------------- 0.06s Test network validations ------------------------------------------------ 0.06s Fail if needed ---------------------------------------------------------- 0.06s reproducer : Ensure all standard attached networks are defined ---------- 0.06s reproducer : Ensure all standard attached networks are defined ---------- 0.06s reproducer : Ensure we don't have extra network defined ----------------- 0.06s reproducer : Ensure all standard attached networks are defined ---------- 0.05s reproducer : Ensure all standard attached networks are defined ---------- 0.05s reproducer : Ensure all standard attached networks are defined ---------- 0.05s reproducer : Fail for good ---------------------------------------------- 0.05s reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s Mark run as failed ------------------------------------------------------ 0.05s PLAY [Prepare] ***************************************************************** TASK [Set failed fact] ********************************************************* Monday 24 November 2025 08:49:28 +0000 (0:00:00.033) 0:00:00.033 ******* ok: [instance] TASK [Load scenarios] ********************************************************** Monday 24 November 2025 08:49:28 +0000 (0:00:00.021) 0:00:00.055 ******* ok: [instance] TASK [Test no volumes] ********************************************************* Monday 24 November 2025 08:49:28 +0000 (0:00:00.024) 0:00:00.079 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:28 +0000 (0:00:00.097) 0:00:00.176 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:28 +0000 (0:00:00.022) 0:00:00.199 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:28 +0000 (0:00:00.025) 0:00:00.225 ******* ok: [instance] => msg: 'Running: No volume, no worker' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:28 +0000 (0:00:00.027) 0:00:00.252 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:28 +0000 (0:00:00.064) 0:00:00.317 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:28 +0000 (0:00:00.056) 0:00:00.373 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:28 +0000 (0:00:00.041) 0:00:00.415 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:28 +0000 (0:00:00.067) 0:00:00.483 ******* skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:29 +0000 (0:00:00.038) 0:00:00.522 ******* ok: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Monday 24 November 2025 08:49:29 +0000 (0:00:00.048) 0:00:00.570 ******* skipping: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Monday 24 November 2025 08:49:29 +0000 (0:00:00.040) 0:00:00.611 ******* skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Monday 24 November 2025 08:49:29 +0000 (0:00:00.039) 0:00:00.650 ******* skipping: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Monday 24 November 2025 08:49:29 +0000 (0:00:00.052) 0:00:00.703 ******* skipping: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Monday 24 November 2025 08:49:29 +0000 (0:00:00.041) 0:00:00.745 ******* skipping: [instance] TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Monday 24 November 2025 08:49:29 +0000 (0:00:00.041) 0:00:00.786 ******* skipping: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:29 +0000 (0:00:00.047) 0:00:00.833 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:29 +0000 (0:00:00.034) 0:00:00.868 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:29 +0000 (0:00:00.030) 0:00:00.898 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:29 +0000 (0:00:00.032) 0:00:00.930 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:29 +0000 (0:00:00.021) 0:00:00.952 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:29 +0000 (0:00:00.026) 0:00:00.978 ******* ok: [instance] => msg: 'Running: No volume, with worker' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:29 +0000 (0:00:00.024) 0:00:01.002 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:29 +0000 (0:00:00.045) 0:00:01.048 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:29 +0000 (0:00:00.057) 0:00:01.105 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:29 +0000 (0:00:00.040) 0:00:01.146 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:29 +0000 (0:00:00.091) 0:00:01.237 ******* ok: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:29 +0000 (0:00:00.067) 0:00:01.305 ******* ok: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Monday 24 November 2025 08:49:29 +0000 (0:00:00.050) 0:00:01.355 ******* skipping: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Monday 24 November 2025 08:49:29 +0000 (0:00:00.037) 0:00:01.392 ******* skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Monday 24 November 2025 08:49:29 +0000 (0:00:00.039) 0:00:01.432 ******* skipping: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Monday 24 November 2025 08:49:29 +0000 (0:00:00.041) 0:00:01.473 ******* skipping: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Monday 24 November 2025 08:49:30 +0000 (0:00:00.041) 0:00:01.514 ******* skipping: [instance] TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Monday 24 November 2025 08:49:30 +0000 (0:00:00.039) 0:00:01.554 ******* skipping: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:30 +0000 (0:00:00.050) 0:00:01.605 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:30 +0000 (0:00:00.034) 0:00:01.639 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:30 +0000 (0:00:00.033) 0:00:01.673 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:30 +0000 (0:00:00.033) 0:00:01.707 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:30 +0000 (0:00:00.022) 0:00:01.729 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:30 +0000 (0:00:00.025) 0:00:01.755 ******* ok: [instance] => msg: 'Running: Volume, no worker' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:30 +0000 (0:00:00.025) 0:00:01.781 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:30 +0000 (0:00:00.044) 0:00:01.826 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:30 +0000 (0:00:00.057) 0:00:01.883 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:30 +0000 (0:00:00.040) 0:00:01.924 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:30 +0000 (0:00:00.069) 0:00:01.993 ******* skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:30 +0000 (0:00:00.039) 0:00:02.033 ******* skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Monday 24 November 2025 08:49:30 +0000 (0:00:00.042) 0:00:02.075 ******* ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Monday 24 November 2025 08:49:30 +0000 (0:00:00.046) 0:00:02.122 ******* skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Monday 24 November 2025 08:49:30 +0000 (0:00:00.090) 0:00:02.213 ******* ok: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Monday 24 November 2025 08:49:30 +0000 (0:00:00.065) 0:00:02.278 ******* ok: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Monday 24 November 2025 08:49:30 +0000 (0:00:00.065) 0:00:02.344 ******* ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Monday 24 November 2025 08:49:30 +0000 (0:00:00.067) 0:00:02.412 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:30 +0000 (0:00:00.079) 0:00:02.491 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:31 +0000 (0:00:00.038) 0:00:02.529 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:31 +0000 (0:00:00.031) 0:00:02.561 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:31 +0000 (0:00:00.033) 0:00:02.595 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:31 +0000 (0:00:00.022) 0:00:02.618 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:31 +0000 (0:00:00.026) 0:00:02.645 ******* ok: [instance] => msg: 'Running: Volume, with worker' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:31 +0000 (0:00:00.024) 0:00:02.669 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:31 +0000 (0:00:00.041) 0:00:02.711 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:31 +0000 (0:00:00.060) 0:00:02.772 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:31 +0000 (0:00:00.043) 0:00:02.816 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:31 +0000 (0:00:00.071) 0:00:02.888 ******* ok: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:31 +0000 (0:00:00.068) 0:00:02.956 ******* skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Monday 24 November 2025 08:49:31 +0000 (0:00:00.042) 0:00:02.999 ******* ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Monday 24 November 2025 08:49:31 +0000 (0:00:00.045) 0:00:03.044 ******* ok: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Monday 24 November 2025 08:49:31 +0000 (0:00:00.054) 0:00:03.098 ******* ok: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Monday 24 November 2025 08:49:31 +0000 (0:00:00.067) 0:00:03.166 ******* ok: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Monday 24 November 2025 08:49:31 +0000 (0:00:00.090) 0:00:03.257 ******* ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Monday 24 November 2025 08:49:31 +0000 (0:00:00.068) 0:00:03.326 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:31 +0000 (0:00:00.081) 0:00:03.408 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:31 +0000 (0:00:00.037) 0:00:03.445 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:31 +0000 (0:00:00.035) 0:00:03.481 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.032) 0:00:03.514 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.022) 0:00:03.536 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.024) 0:00:03.561 ******* ok: [instance] => msg: 'Running: Too many allocated volumes' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.027) 0:00:03.588 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:32 +0000 (0:00:00.045) 0:00:03.633 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.057) 0:00:03.691 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:32 +0000 (0:00:00.042) 0:00:03.734 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:32 +0000 (0:00:00.070) 0:00:03.804 ******* skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:32 +0000 (0:00:00.041) 0:00:03.846 ******* skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Monday 24 November 2025 08:49:32 +0000 (0:00:00.043) 0:00:03.889 ******* ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.044) 0:00:03.934 ******* skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Monday 24 November 2025 08:49:32 +0000 (0:00:00.042) 0:00:03.977 ******* fatal: [instance]: FAILED! => changed=false assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int evaluated_to: false msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' TASK [Clear host errors] ******************************************************* Monday 24 November 2025 08:49:32 +0000 (0:00:00.068) 0:00:04.045 ******* TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.018) 0:00:04.064 ******* ok: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:32 +0000 (0:00:00.023) 0:00:04.087 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.035) 0:00:04.123 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.057) 0:00:04.180 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.032) 0:00:04.213 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.021) 0:00:04.235 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.029) 0:00:04.265 ******* ok: [instance] => msg: 'Running: Different volume amount' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.025) 0:00:04.290 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:32 +0000 (0:00:00.040) 0:00:04.331 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:32 +0000 (0:00:00.058) 0:00:04.390 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:32 +0000 (0:00:00.041) 0:00:04.431 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:32 +0000 (0:00:00.071) 0:00:04.503 ******* ok: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:33 +0000 (0:00:00.068) 0:00:04.572 ******* skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Monday 24 November 2025 08:49:33 +0000 (0:00:00.043) 0:00:04.615 ******* ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.043) 0:00:04.659 ******* fatal: [instance]: FAILED! => changed=false assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 evaluated_to: false msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' TASK [Clear host errors] ******************************************************* Monday 24 November 2025 08:49:33 +0000 (0:00:00.056) 0:00:04.715 ******* TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.016) 0:00:04.731 ******* ok: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:33 +0000 (0:00:00.021) 0:00:04.753 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.041) 0:00:04.794 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.034) 0:00:04.828 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.031) 0:00:04.860 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.023) 0:00:04.883 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.025) 0:00:04.909 ******* ok: [instance] => msg: 'Running: Create LVM without volume' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.024) 0:00:04.934 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:33 +0000 (0:00:00.063) 0:00:04.997 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.056) 0:00:05.054 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:33 +0000 (0:00:00.042) 0:00:05.096 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:33 +0000 (0:00:00.070) 0:00:05.166 ******* skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:33 +0000 (0:00:00.040) 0:00:05.207 ******* fatal: [instance]: FAILED! => changed=false assertion: not cifmw_devscripts_create_logical_volume | bool evaluated_to: false msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' TASK [Clear host errors] ******************************************************* Monday 24 November 2025 08:49:33 +0000 (0:00:00.046) 0:00:05.253 ******* TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.016) 0:00:05.269 ******* ok: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:33 +0000 (0:00:00.021) 0:00:05.291 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.034) 0:00:05.325 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.031) 0:00:05.356 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.034) 0:00:05.391 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.022) 0:00:05.414 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.025) 0:00:05.439 ******* ok: [instance] => msg: 'Running: Create LVMS without volume' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:33 +0000 (0:00:00.026) 0:00:05.466 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:33 +0000 (0:00:00.042) 0:00:05.508 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:34 +0000 (0:00:00.056) 0:00:05.565 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:34 +0000 (0:00:00.046) 0:00:05.611 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:34 +0000 (0:00:00.068) 0:00:05.680 ******* skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:34 +0000 (0:00:00.041) 0:00:05.721 ******* fatal: [instance]: FAILED! => changed=false assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 evaluated_to: false msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' TASK [Clear host errors] ******************************************************* Monday 24 November 2025 08:49:34 +0000 (0:00:00.052) 0:00:05.774 ******* TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:34 +0000 (0:00:00.018) 0:00:05.792 ******* ok: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:34 +0000 (0:00:00.024) 0:00:05.816 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:34 +0000 (0:00:00.069) 0:00:05.886 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:34 +0000 (0:00:00.032) 0:00:05.919 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:34 +0000 (0:00:00.037) 0:00:05.956 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:34 +0000 (0:00:00.022) 0:00:05.979 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:34 +0000 (0:00:00.026) 0:00:06.005 ******* ok: [instance] => msg: 'Running: Allocate same volume twice' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:34 +0000 (0:00:00.024) 0:00:06.030 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:34 +0000 (0:00:00.041) 0:00:06.072 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:34 +0000 (0:00:00.059) 0:00:06.131 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:34 +0000 (0:00:00.040) 0:00:06.171 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:34 +0000 (0:00:00.071) 0:00:06.242 ******* skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:34 +0000 (0:00:00.039) 0:00:06.282 ******* skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Monday 24 November 2025 08:49:34 +0000 (0:00:00.045) 0:00:06.328 ******* ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Monday 24 November 2025 08:49:34 +0000 (0:00:00.045) 0:00:06.373 ******* skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Monday 24 November 2025 08:49:34 +0000 (0:00:00.041) 0:00:06.414 ******* fatal: [instance]: FAILED! => changed=false assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int evaluated_to: false msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' TASK [Clear host errors] ******************************************************* Monday 24 November 2025 08:49:34 +0000 (0:00:00.069) 0:00:06.484 ******* TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:34 +0000 (0:00:00.016) 0:00:06.500 ******* ok: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:35 +0000 (0:00:00.022) 0:00:06.522 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:35 +0000 (0:00:00.036) 0:00:06.559 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:35 +0000 (0:00:00.032) 0:00:06.591 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:35 +0000 (0:00:00.034) 0:00:06.626 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:35 +0000 (0:00:00.022) 0:00:06.648 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:35 +0000 (0:00:00.028) 0:00:06.676 ******* ok: [instance] => msg: 'Running: Allocate same volume twice - no LVMS' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:35 +0000 (0:00:00.059) 0:00:06.736 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:35 +0000 (0:00:00.042) 0:00:06.779 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:35 +0000 (0:00:00.058) 0:00:06.837 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:35 +0000 (0:00:00.046) 0:00:06.884 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:35 +0000 (0:00:00.072) 0:00:06.957 ******* skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:35 +0000 (0:00:00.044) 0:00:07.001 ******* skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Monday 24 November 2025 08:49:35 +0000 (0:00:00.042) 0:00:07.043 ******* ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Monday 24 November 2025 08:49:35 +0000 (0:00:00.048) 0:00:07.091 ******* skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Monday 24 November 2025 08:49:35 +0000 (0:00:00.046) 0:00:07.137 ******* ok: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Monday 24 November 2025 08:49:35 +0000 (0:00:00.068) 0:00:07.206 ******* skipping: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Monday 24 November 2025 08:49:35 +0000 (0:00:00.051) 0:00:07.257 ******* ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Monday 24 November 2025 08:49:35 +0000 (0:00:00.072) 0:00:07.330 ******* ok: [instance] => changed=false msg: All assertions passed TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:35 +0000 (0:00:00.081) 0:00:07.411 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:35 +0000 (0:00:00.036) 0:00:07.448 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:35 +0000 (0:00:00.033) 0:00:07.481 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.033) 0:00:07.515 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.022) 0:00:07.537 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.027) 0:00:07.565 ******* ok: [instance] => msg: 'Running: Allocate same volume twice - no cinder_lvm' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.026) 0:00:07.591 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:36 +0000 (0:00:00.042) 0:00:07.633 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.084) 0:00:07.717 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:36 +0000 (0:00:00.042) 0:00:07.760 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:36 +0000 (0:00:00.073) 0:00:07.833 ******* skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:36 +0000 (0:00:00.041) 0:00:07.874 ******* skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Monday 24 November 2025 08:49:36 +0000 (0:00:00.045) 0:00:07.919 ******* ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.047) 0:00:07.967 ******* skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Monday 24 November 2025 08:49:36 +0000 (0:00:00.042) 0:00:08.010 ******* ok: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Monday 24 November 2025 08:49:36 +0000 (0:00:00.066) 0:00:08.076 ******* skipping: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.050) 0:00:08.127 ******* ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Monday 24 November 2025 08:49:36 +0000 (0:00:00.072) 0:00:08.200 ******* skipping: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:36 +0000 (0:00:00.060) 0:00:08.261 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.039) 0:00:08.300 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.036) 0:00:08.336 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.034) 0:00:08.371 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.025) 0:00:08.396 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.026) 0:00:08.422 ******* ok: [instance] => msg: 'Running: Config overrides via devscripts' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:36 +0000 (0:00:00.025) 0:00:08.448 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:36 +0000 (0:00:00.041) 0:00:08.490 ******* fatal: [instance]: FAILED! => changed=false assertion: cifmw_devscripts_config.master_memory is undefined evaluated_to: false msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' TASK [Clear host errors] ******************************************************* Monday 24 November 2025 08:49:37 +0000 (0:00:00.045) 0:00:08.535 ******* TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.016) 0:00:08.551 ******* ok: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:37 +0000 (0:00:00.021) 0:00:08.573 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.063) 0:00:08.637 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.034) 0:00:08.671 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.039) 0:00:08.711 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.021) 0:00:08.733 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.025) 0:00:08.758 ******* ok: [instance] => msg: 'Running: Inject 10 dev-scripts extra_worker' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.026) 0:00:08.784 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:37 +0000 (0:00:00.042) 0:00:08.826 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.059) 0:00:08.886 ******* fatal: [instance]: FAILED! => changed=false assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 evaluated_to: false msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' TASK [Clear host errors] ******************************************************* Monday 24 November 2025 08:49:37 +0000 (0:00:00.043) 0:00:08.929 ******* TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.016) 0:00:08.946 ******* ok: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:37 +0000 (0:00:00.022) 0:00:08.968 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.066) 0:00:09.035 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.031) 0:00:09.066 ******* skipping: [instance] TASK [Mark run as failed] ****************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.031) 0:00:09.098 ******* ok: [instance] TASK [Load environment file] *************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.020) 0:00:09.118 ******* ok: [instance] TASK [Output scenario name] **************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.024) 0:00:09.143 ******* ok: [instance] => msg: 'Running: Inject 0 dev-scripts extra_worker' TASK [Validate data] *********************************************************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.026) 0:00:09.170 ******* TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Monday 24 November 2025 08:49:37 +0000 (0:00:00.045) 0:00:09.215 ******* ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Monday 24 November 2025 08:49:37 +0000 (0:00:00.060) 0:00:09.276 ******* ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Monday 24 November 2025 08:49:37 +0000 (0:00:00.045) 0:00:09.321 ******* ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Monday 24 November 2025 08:49:37 +0000 (0:00:00.070) 0:00:09.391 ******* skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Monday 24 November 2025 08:49:37 +0000 (0:00:00.075) 0:00:09.467 ******* ok: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Monday 24 November 2025 08:49:38 +0000 (0:00:00.051) 0:00:09.519 ******* skipping: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Monday 24 November 2025 08:49:38 +0000 (0:00:00.042) 0:00:09.561 ******* skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Monday 24 November 2025 08:49:38 +0000 (0:00:00.039) 0:00:09.600 ******* skipping: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Monday 24 November 2025 08:49:38 +0000 (0:00:00.043) 0:00:09.644 ******* skipping: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Monday 24 November 2025 08:49:38 +0000 (0:00:00.042) 0:00:09.687 ******* skipping: [instance] TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Monday 24 November 2025 08:49:38 +0000 (0:00:00.041) 0:00:09.729 ******* skipping: [instance] TASK [Mark failure] ************************************************************ Monday 24 November 2025 08:49:38 +0000 (0:00:00.049) 0:00:09.779 ******* skipping: [instance] TASK [Display error message] *************************************************** Monday 24 November 2025 08:49:38 +0000 (0:00:00.038) 0:00:09.817 ******* skipping: [instance] TASK [Append failed scenario to list] ****************************************** Monday 24 November 2025 08:49:38 +0000 (0:00:00.032) 0:00:09.850 ******* skipping: [instance] TASK [Fail if needed] ********************************************************** Monday 24 November 2025 08:49:38 +0000 (0:00:00.037) 0:00:09.887 ******* skipping: [instance] PLAY RECAP ********************************************************************* instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 Monday 24 November 2025 08:49:38 +0000 (0:00:00.057) 0:00:09.945 ******* =============================================================================== Test no volumes --------------------------------------------------------- 0.10s reproducer : Ensure we get required data in the layout description ------ 0.09s reproducer : Ensure no allocation overlap ------------------------------- 0.09s reproducer : Ensure same amount of disks are created -------------------- 0.09s reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.08s reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.08s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure LVMS allocated disks are available ------------------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure LVMS allocated disks are available ------------------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s Mark failure ------------------------------------------------------------ 0.07s