PLAY [Prepare] ***************************************************************** TASK [Gathering Facts] ********************************************************* Friday 03 October 2025 13:11:33 +0000 (0:00:00.020) 0:00:00.020 ******** ok: [instance] TASK [Create custom basedir] *************************************************** Friday 03 October 2025 13:11:33 +0000 (0:00:00.826) 0:00:00.847 ******** changed: [instance] TASK [test_deps : Gather facts if they don't exist] **************************** Friday 03 October 2025 13:11:34 +0000 (0:00:00.306) 0:00:01.153 ******** skipping: [instance] TASK [test_deps : Gather variables for each operating system] ****************** Friday 03 October 2025 13:11:34 +0000 (0:00:00.017) 0:00:01.171 ******** ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) TASK [test_deps : Detect mirrors file] ***************************************** Friday 03 October 2025 13:11:34 +0000 (0:00:00.041) 0:00:01.212 ******** ok: [instance] TASK [test_deps : Disable ubi host subscription-manager integration] *********** Friday 03 October 2025 13:11:34 +0000 (0:00:00.275) 0:00:01.488 ******** ok: [instance] TASK [test_deps : Disable ubi 9 repos] ***************************************** Friday 03 October 2025 13:11:34 +0000 (0:00:00.215) 0:00:01.703 ******** ok: [instance] => (item=ubi-9-appstream) ok: [instance] => (item=ubi-9-baseos) ok: [instance] => (item=ubi-9-codeready-builder) TASK [Deploy repo-setup] ******************************************************* Friday 03 October 2025 13:11:35 +0000 (0:00:00.689) 0:00:02.393 ******** TASK [repo_setup : Ensure directories are present] ***************************** Friday 03 October 2025 13:11:35 +0000 (0:00:00.059) 0:00:02.452 ******** changed: [instance] => (item=tmp) changed: [instance] => (item=artifacts/repositories) changed: [instance] => (item=venv/repo_setup) TASK [repo_setup : Make sure git-core package is installed] ******************** Friday 03 October 2025 13:11:36 +0000 (0:00:00.528) 0:00:02.981 ******** ok: [instance] TASK [repo_setup : Get repo-setup repository] ********************************** Friday 03 October 2025 13:11:36 +0000 (0:00:00.800) 0:00:03.782 ******** changed: [instance] TASK [repo_setup : Initialize python venv and install requirements] ************ Friday 03 October 2025 13:11:38 +0000 (0:00:01.191) 0:00:04.973 ******** changed: [instance] TASK [repo_setup : Install repo-setup package] ********************************* Friday 03 October 2025 13:11:46 +0000 (0:00:07.994) 0:00:12.968 ******** changed: [instance] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Friday 03 October 2025 13:11:46 +0000 (0:00:00.722) 0:00:13.690 ******** skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Friday 03 October 2025 13:11:46 +0000 (0:00:00.022) 0:00:13.713 ******** changed: [instance] TASK [repo_setup : Get component repo] ***************************************** Friday 03 October 2025 13:11:47 +0000 (0:00:00.837) 0:00:14.551 ******** skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Friday 03 October 2025 13:11:47 +0000 (0:00:00.037) 0:00:14.588 ******** skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Friday 03 October 2025 13:11:47 +0000 (0:00:00.036) 0:00:14.624 ******** skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Friday 03 October 2025 13:11:47 +0000 (0:00:00.036) 0:00:14.661 ******** changed: [instance] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Friday 03 October 2025 13:11:48 +0000 (0:00:00.547) 0:00:15.209 ******** changed: [instance] TASK [repo_setup : Dump current-podified hash] ********************************* Friday 03 October 2025 13:11:48 +0000 (0:00:00.450) 0:00:15.659 ******** skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Friday 03 October 2025 13:11:48 +0000 (0:00:00.029) 0:00:15.689 ******** skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Friday 03 October 2025 13:11:48 +0000 (0:00:00.028) 0:00:15.718 ******** skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Friday 03 October 2025 13:11:48 +0000 (0:00:00.027) 0:00:15.745 ******** ok: [instance] TASK [repo_setup : Create download directory] ********************************** Friday 03 October 2025 13:11:48 +0000 (0:00:00.036) 0:00:15.782 ******** skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Friday 03 October 2025 13:11:48 +0000 (0:00:00.026) 0:00:15.809 ******** skipping: [instance] TASK [Download the RPM] ******************************************************** Friday 03 October 2025 13:11:48 +0000 (0:00:00.025) 0:00:15.835 ******** skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Friday 03 October 2025 13:11:48 +0000 (0:00:00.028) 0:00:15.863 ******** skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Friday 03 October 2025 13:11:49 +0000 (0:00:00.027) 0:00:15.891 ******** skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Friday 03 October 2025 13:11:49 +0000 (0:00:00.026) 0:00:15.917 ******** skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Friday 03 October 2025 13:11:49 +0000 (0:00:00.028) 0:00:15.946 ******** skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Friday 03 October 2025 13:11:49 +0000 (0:00:00.026) 0:00:15.972 ******** ok: [instance] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Friday 03 October 2025 13:11:49 +0000 (0:00:00.180) 0:00:16.153 ******** changed: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Friday 03 October 2025 13:11:49 +0000 (0:00:00.210) 0:00:16.363 ******** changed: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Friday 03 October 2025 13:11:49 +0000 (0:00:00.242) 0:00:16.606 ******** skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Friday 03 October 2025 13:11:49 +0000 (0:00:00.021) 0:00:16.627 ******** skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Friday 03 October 2025 13:11:49 +0000 (0:00:00.021) 0:00:16.649 ******** skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Friday 03 October 2025 13:11:49 +0000 (0:00:00.021) 0:00:16.671 ******** skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Friday 03 October 2025 13:11:49 +0000 (0:00:00.020) 0:00:16.691 ******** skipping: [instance] TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** Friday 03 October 2025 13:11:49 +0000 (0:00:00.020) 0:00:16.712 ******** skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Friday 03 October 2025 13:11:49 +0000 (0:00:00.022) 0:00:16.734 ******** skipping: [instance] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Friday 03 October 2025 13:11:49 +0000 (0:00:00.018) 0:00:16.753 ******** skipping: [instance] TASK [repo_setup : Cleanup existing metadata] ********************************** Friday 03 October 2025 13:11:49 +0000 (0:00:00.029) 0:00:16.783 ******** skipping: [instance] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Friday 03 October 2025 13:11:49 +0000 (0:00:00.016) 0:00:16.799 ******** skipping: [instance] TASK [test_deps : Look for redhat-release rpm] ********************************* Friday 03 October 2025 13:11:49 +0000 (0:00:00.020) 0:00:16.820 ******** skipping: [instance] TASK [test_deps : Remove redhat-release] *************************************** Friday 03 October 2025 13:11:49 +0000 (0:00:00.030) 0:00:16.850 ******** skipping: [instance] TASK [test_deps : Install centos-stream-release] ******************************* Friday 03 October 2025 13:11:49 +0000 (0:00:00.029) 0:00:16.880 ******** skipping: [instance] TASK [test_deps : Install additional packages] ********************************* Friday 03 October 2025 13:11:50 +0000 (0:00:00.029) 0:00:16.909 ******** skipping: [instance] TASK [test_deps : Install selinux python libs] ********************************* Friday 03 October 2025 13:11:50 +0000 (0:00:00.029) 0:00:16.939 ******** ok: [instance] TASK [test_deps : Install python yaml libs] ************************************ Friday 03 October 2025 13:12:33 +0000 (0:00:43.023) 0:00:59.963 ******** ok: [instance] TASK [test_deps : Install extra packages] ************************************** Friday 03 October 2025 13:12:34 +0000 (0:00:01.216) 0:01:01.179 ******** skipping: [instance] TASK [ci_setup : Gather variables for each operating system] ******************* Friday 03 October 2025 13:12:34 +0000 (0:00:00.030) 0:01:01.210 ******** ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) TASK [ci_setup : List packages to install] ************************************* Friday 03 October 2025 13:12:34 +0000 (0:00:00.040) 0:01:01.251 ******** ok: [instance] => cifmw_ci_setup_packages: - bash-completion - ca-certificates - git-core - make - tar - tmux - python3-pip TASK [ci_setup : Install needed packages] ************************************** Friday 03 October 2025 13:12:34 +0000 (0:00:00.017) 0:01:01.269 ******** changed: [instance] TASK [ci_setup : Gather version of openshift client] *************************** Friday 03 October 2025 13:12:40 +0000 (0:00:05.969) 0:01:07.238 ******** ok: [instance] TASK [ci_setup : Ensure openshift client install path is present] ************** Friday 03 October 2025 13:12:40 +0000 (0:00:00.570) 0:01:07.809 ******** changed: [instance] TASK [ci_setup : Install openshift client] ************************************* Friday 03 October 2025 13:12:41 +0000 (0:00:00.204) 0:01:08.013 ******** changed: [instance] TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** Friday 03 October 2025 13:12:47 +0000 (0:00:05.986) 0:01:14.000 ******** ok: [instance] TASK [ci_setup : Create completion file] *************************************** Friday 03 October 2025 13:12:47 +0000 (0:00:00.035) 0:01:14.035 ******** changed: [instance] TASK [ci_setup : Source completion from within .bashrc] ************************ Friday 03 October 2025 13:12:47 +0000 (0:00:00.260) 0:01:14.296 ******** changed: [instance] TASK [ci_setup : Check rhsm status] ******************************************** Friday 03 October 2025 13:12:47 +0000 (0:00:00.280) 0:01:14.577 ******** skipping: [instance] TASK [ci_setup : Gather the repos to be enabled] ******************************* Friday 03 October 2025 13:12:47 +0000 (0:00:00.017) 0:01:14.595 ******** skipping: [instance] TASK [ci_setup : Enabling the required repositories.] ************************** Friday 03 October 2025 13:12:47 +0000 (0:00:00.016) 0:01:14.612 ******** skipping: [instance] TASK [ci_setup : Get current /etc/redhat-release] ****************************** Friday 03 October 2025 13:12:47 +0000 (0:00:00.020) 0:01:14.633 ******** skipping: [instance] TASK [ci_setup : Print current /etc/redhat-release] **************************** Friday 03 October 2025 13:12:47 +0000 (0:00:00.017) 0:01:14.650 ******** skipping: [instance] TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* Friday 03 October 2025 13:12:47 +0000 (0:00:00.016) 0:01:14.667 ******** skipping: [instance] TASK [ci_setup : Manage directories] ******************************************* Friday 03 October 2025 13:12:47 +0000 (0:00:00.021) 0:01:14.688 ******** changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) changed: [instance] => (item=/opt/basedir/logs) ok: [instance] => (item=/opt/basedir/tmp) changed: [instance] => (item=/opt/basedir/volumes) changed: [instance] => (item=/opt/basedir/artifacts/parameters) TASK [Create secret file] ****************************************************** Friday 03 October 2025 13:12:48 +0000 (0:00:00.973) 0:01:15.662 ******** changed: [instance] PLAY RECAP ********************************************************************* instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 Friday 03 October 2025 13:12:49 +0000 (0:00:00.339) 0:01:16.001 ******** =============================================================================== test_deps : Install selinux python libs -------------------------------- 43.02s repo_setup : Initialize python venv and install requirements ------------ 7.99s ci_setup : Install openshift client ------------------------------------- 5.99s ci_setup : Install needed packages -------------------------------------- 5.97s test_deps : Install python yaml libs ------------------------------------ 1.22s repo_setup : Get repo-setup repository ---------------------------------- 1.19s ci_setup : Manage directories ------------------------------------------- 0.97s repo_setup : Run repo-setup --------------------------------------------- 0.84s Gathering Facts --------------------------------------------------------- 0.83s repo_setup : Make sure git-core package is installed -------------------- 0.80s repo_setup : Install repo-setup package --------------------------------- 0.72s test_deps : Disable ubi 9 repos ----------------------------------------- 0.69s ci_setup : Gather version of openshift client --------------------------- 0.57s repo_setup : Run repo-setup-get-hash ------------------------------------ 0.55s repo_setup : Ensure directories are present ----------------------------- 0.53s repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.45s Create secret file ------------------------------------------------------ 0.34s Create custom basedir --------------------------------------------------- 0.31s ci_setup : Source completion from within .bashrc ------------------------ 0.28s test_deps : Detect mirrors file ----------------------------------------- 0.28s PLAY [Converge] **************************************************************** TASK [Gathering Facts] ********************************************************* Friday 03 October 2025 13:12:49 +0000 (0:00:00.028) 0:00:00.028 ******** ok: [instance] TASK [Load networking definition from scenario file] *************************** Friday 03 October 2025 13:12:50 +0000 (0:00:00.830) 0:00:00.859 ******** ok: [instance] TASK [discover_latest_image : Get latest image] ******************************** Friday 03 October 2025 13:12:50 +0000 (0:00:00.022) 0:00:00.882 ******** changed: [instance] TASK [discover_latest_image : Export facts accordingly] ************************ Friday 03 October 2025 13:12:52 +0000 (0:00:01.601) 0:00:02.483 ******** ok: [instance] TASK [reproducer : Load CI job environment] ************************************ Friday 03 October 2025 13:12:52 +0000 (0:00:00.028) 0:00:02.512 ******** skipping: [instance] TASK [reproducer : Discover and expose CI Framework path on remote node] ******* Friday 03 October 2025 13:12:52 +0000 (0:00:00.023) 0:00:02.536 ******** ok: [instance] TASK [Build final libvirt layout] ********************************************** Friday 03 October 2025 13:12:52 +0000 (0:00:00.057) 0:00:02.593 ******** TASK [libvirt_manager : Chose right parameter for layout definition] *********** Friday 03 October 2025 13:12:52 +0000 (0:00:00.054) 0:00:02.648 ******** ok: [instance] TASK [libvirt_manager : Patch the layout if needed] **************************** Friday 03 October 2025 13:12:52 +0000 (0:00:00.100) 0:00:02.748 ******** skipping: [instance] TASK [reproducer : Assert no conflicting parameters were passed] *************** Friday 03 October 2025 13:12:52 +0000 (0:00:00.066) 0:00:02.815 ******** ok: [instance] TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** Friday 03 October 2025 13:12:52 +0000 (0:00:00.033) 0:00:02.849 ******** ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Set _use_crc based on actual layout] ************************ Friday 03 October 2025 13:12:52 +0000 (0:00:00.027) 0:00:02.876 ******** ok: [instance] TASK [reproducer : Ensure directories are present] ***************************** Friday 03 October 2025 13:12:52 +0000 (0:00:00.044) 0:00:02.920 ******** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [Bootstrap libvirt if needed] ********************************************* Friday 03 October 2025 13:12:53 +0000 (0:00:00.467) 0:00:03.387 ******** TASK [libvirt_manager : Ensure output directory exists] ************************ Friday 03 October 2025 13:12:53 +0000 (0:00:00.076) 0:00:03.464 ******** ok: [instance] TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* Friday 03 October 2025 13:12:53 +0000 (0:00:00.198) 0:00:03.662 ******** changed: [instance] TASK [libvirt_manager : Check if KVM is enabled] ******************************* Friday 03 October 2025 13:12:53 +0000 (0:00:00.288) 0:00:03.951 ******** ok: [instance] TASK [libvirt_manager : Fail if KVM not enabled] ******************************* Friday 03 October 2025 13:12:53 +0000 (0:00:00.283) 0:00:04.235 ******** skipping: [instance] TASK [libvirt_manager : Check if VMX virtualization] *************************** Friday 03 October 2025 13:12:54 +0000 (0:00:00.030) 0:00:04.265 ******** skipping: [instance] TASK [libvirt_manager : Check if SVM virtualization] *************************** Friday 03 October 2025 13:12:54 +0000 (0:00:00.018) 0:00:04.284 ******** ok: [instance] TASK [libvirt_manager : Enable VMX virtualization] ***************************** Friday 03 October 2025 13:12:54 +0000 (0:00:00.021) 0:00:04.305 ******** skipping: [instance] TASK [libvirt_manager : Install packages required for using KVM] *************** Friday 03 October 2025 13:12:54 +0000 (0:00:00.028) 0:00:04.334 ******** changed: [instance] TASK [libvirt_manager : Create rules.d polkit folder] ************************** Friday 03 October 2025 13:13:02 +0000 (0:00:08.422) 0:00:12.757 ******** changed: [instance] TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* Friday 03 October 2025 13:13:02 +0000 (0:00:00.207) 0:00:12.964 ******** changed: [instance] TASK [libvirt_manager : Restart service polkit service] ************************ Friday 03 October 2025 13:13:03 +0000 (0:00:00.613) 0:00:13.577 ******** changed: [instance] TASK [libvirt_manager : Remove directory for service override] ***************** Friday 03 October 2025 13:13:03 +0000 (0:00:00.577) 0:00:14.155 ******** ok: [instance] TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** Friday 03 October 2025 13:13:04 +0000 (0:00:00.196) 0:00:14.352 ******** ok: [instance] TASK [libvirt_manager : Ensure firewalld service is up] ************************ Friday 03 October 2025 13:13:04 +0000 (0:00:00.660) 0:00:15.012 ******** changed: [instance] TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** Friday 03 October 2025 13:13:05 +0000 (0:00:00.894) 0:00:15.907 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* Friday 03 October 2025 13:13:05 +0000 (0:00:00.085) 0:00:15.993 ******** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** Friday 03 October 2025 13:13:06 +0000 (0:00:00.345) 0:00:16.338 ******** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** Friday 03 October 2025 13:13:07 +0000 (0:00:01.332) 0:00:17.670 ******** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** Friday 03 October 2025 13:13:07 +0000 (0:00:00.330) 0:00:18.001 ******** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** Friday 03 October 2025 13:13:09 +0000 (0:00:01.328) 0:00:19.329 ******** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* Friday 03 October 2025 13:13:09 +0000 (0:00:00.325) 0:00:19.655 ******** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** Friday 03 October 2025 13:13:09 +0000 (0:00:00.328) 0:00:19.983 ******** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* Friday 03 October 2025 13:13:10 +0000 (0:00:00.320) 0:00:20.304 ******** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** Friday 03 October 2025 13:13:10 +0000 (0:00:00.320) 0:00:20.624 ******** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** Friday 03 October 2025 13:13:10 +0000 (0:00:00.326) 0:00:20.951 ******** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* Friday 03 October 2025 13:13:11 +0000 (0:00:00.324) 0:00:21.276 ******** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** Friday 03 October 2025 13:13:11 +0000 (0:00:00.324) 0:00:21.600 ******** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** Friday 03 October 2025 13:13:11 +0000 (0:00:00.331) 0:00:21.931 ******** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** Friday 03 October 2025 13:13:12 +0000 (0:00:00.333) 0:00:22.265 ******** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** Friday 03 October 2025 13:13:12 +0000 (0:00:00.325) 0:00:22.591 ******** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* Friday 03 October 2025 13:13:12 +0000 (0:00:00.327) 0:00:22.919 ******** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** Friday 03 October 2025 13:13:12 +0000 (0:00:00.327) 0:00:23.246 ******** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ Friday 03 October 2025 13:13:13 +0000 (0:00:00.330) 0:00:23.576 ******** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** Friday 03 October 2025 13:13:13 +0000 (0:00:00.347) 0:00:23.924 ******** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* Friday 03 October 2025 13:13:14 +0000 (0:00:00.356) 0:00:24.281 ******** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** Friday 03 October 2025 13:13:14 +0000 (0:00:00.332) 0:00:24.613 ******** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** Friday 03 October 2025 13:13:14 +0000 (0:00:00.336) 0:00:24.949 ******** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* Friday 03 October 2025 13:13:15 +0000 (0:00:00.331) 0:00:25.281 ******** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* Friday 03 October 2025 13:13:15 +0000 (0:00:00.328) 0:00:25.610 ******** ok: [instance] TASK [libvirt_manager : Manage service for older releases] ********************* Friday 03 October 2025 13:13:15 +0000 (0:00:00.330) 0:00:25.940 ******** skipping: [instance] TASK [libvirt_manager : Get libvirt group users] ******************************* Friday 03 October 2025 13:13:15 +0000 (0:00:00.021) 0:00:25.962 ******** ok: [instance] TASK [libvirt_manager : Add user if not exists in libvirt group] *************** Friday 03 October 2025 13:13:15 +0000 (0:00:00.284) 0:00:26.246 ******** ok: [instance] TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** Friday 03 October 2025 13:13:16 +0000 (0:00:00.372) 0:00:26.618 ******** changed: [instance] TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* Friday 03 October 2025 13:13:16 +0000 (0:00:00.309) 0:00:26.928 ******** [WARNING]: Reset is not implemented for this connection changed: [instance] TASK [libvirt_manager : Ensure we reload user env] ***************************** Friday 03 October 2025 13:13:16 +0000 (0:00:00.287) 0:00:27.215 ******** TASK [reproducer : Deploy networks in libvirt] ********************************* Friday 03 October 2025 13:13:16 +0000 (0:00:00.015) 0:00:27.231 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance TASK [reproducer : Ensure networks are consistent] ***************************** Friday 03 October 2025 13:13:17 +0000 (0:00:00.074) 0:00:27.306 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Friday 03 October 2025 13:13:17 +0000 (0:00:00.043) 0:00:27.349 ******** ok: [instance] => (item=compute) ok: [instance] => (item=controller) ok: [instance] => (item=crc) TASK [reproducer : Ensure all standard attached networks are defined] ********** Friday 03 October 2025 13:13:17 +0000 (0:00:00.070) 0:00:27.419 ******** ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Friday 03 October 2025 13:13:17 +0000 (0:00:00.042) 0:00:27.461 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Ensure we get latest OCP config] ***************************************** Friday 03 October 2025 13:13:17 +0000 (0:00:00.042) 0:00:27.504 ******** TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** Friday 03 October 2025 13:13:17 +0000 (0:00:00.043) 0:00:27.548 ******** ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) ok: [instance] => (item={}) TASK [devscripts : Replace OCP version if "stable-" alias used] **************** Friday 03 October 2025 13:13:17 +0000 (0:00:00.074) 0:00:27.622 ******** skipping: [instance] TASK [devscripts : Ensure output directory exists] ***************************** Friday 03 October 2025 13:13:17 +0000 (0:00:00.017) 0:00:27.640 ******** ok: [instance] TASK [devscripts : Output built config for easier debugging] ******************* Friday 03 October 2025 13:13:17 +0000 (0:00:00.222) 0:00:27.862 ******** changed: [instance] TASK [ci_network : Remove the local dns configuration] ************************* Friday 03 October 2025 13:13:17 +0000 (0:00:00.347) 0:00:28.210 ******** ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) TASK [ci_network : Reload the NetworkManager to pick the changes] ************** Friday 03 October 2025 13:13:18 +0000 (0:00:00.747) 0:00:28.958 ******** skipping: [instance] TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* Friday 03 October 2025 13:13:18 +0000 (0:00:00.026) 0:00:28.985 ******** changed: [instance] TASK [reproducer : Flush handlers for NetworkManager restart] ****************** Friday 03 October 2025 13:13:19 +0000 (0:00:00.356) 0:00:29.341 ******** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Friday 03 October 2025 13:13:19 +0000 (0:00:00.008) 0:00:29.350 ******** changed: [instance] TASK [Ensure no default networks exists] *************************************** Friday 03 October 2025 13:13:19 +0000 (0:00:00.420) 0:00:29.770 ******** TASK [libvirt_manager : Deactivate crc] **************************************** Friday 03 October 2025 13:13:19 +0000 (0:00:00.073) 0:00:29.844 ******** ok: [instance] TASK [libvirt_manager : Removing crc] ****************************************** Friday 03 October 2025 13:13:20 +0000 (0:00:01.170) 0:00:31.014 ******** ok: [instance] TASK [libvirt_manager : Deactivate default] ************************************ Friday 03 October 2025 13:13:20 +0000 (0:00:00.231) 0:00:31.245 ******** ok: [instance] TASK [libvirt_manager : Removing default] ************************************** Friday 03 October 2025 13:13:21 +0000 (0:00:00.561) 0:00:31.807 ******** ok: [instance] TASK [reproducer : Ensure firewalld is installed] ****************************** Friday 03 October 2025 13:13:21 +0000 (0:00:00.230) 0:00:32.037 ******** ok: [instance] TASK [reproducer : Ensure firewalld service is enabled and started] ************ Friday 03 October 2025 13:13:23 +0000 (0:00:01.213) 0:00:33.251 ******** ok: [instance] TASK [reproducer : Ensure br_netfilter module is loaded] *********************** Friday 03 October 2025 13:13:23 +0000 (0:00:00.310) 0:00:33.562 ******** changed: [instance] TASK [reproducer : Ensure IP forwarding is enabled] **************************** Friday 03 October 2025 13:13:23 +0000 (0:00:00.303) 0:00:33.866 ******** changed: [instance] TASK [reproducer : Ensure the required parameters are loaded] ****************** Friday 03 October 2025 13:13:23 +0000 (0:00:00.310) 0:00:34.176 ******** changed: [instance] => (item=arptables) changed: [instance] => (item=iptables) changed: [instance] => (item=ip6tables) TASK [reproducer : Ensure firewall service is enabled and started] ************* Friday 03 October 2025 13:13:25 +0000 (0:00:01.589) 0:00:35.765 ******** ok: [instance] TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* Friday 03 October 2025 13:13:25 +0000 (0:00:00.347) 0:00:36.112 ******** ok: [instance] TASK [Ensure the required network configurations are applied] ****************** Friday 03 October 2025 13:13:25 +0000 (0:00:00.093) 0:00:36.206 ******** TASK [networking_mapper : Check for Networking Environment Definition file existence] *** Friday 03 October 2025 13:13:26 +0000 (0:00:00.043) 0:00:36.249 ******** skipping: [instance] TASK [networking_mapper : Check for Networking Definition file existance] ****** Friday 03 October 2025 13:13:26 +0000 (0:00:00.023) 0:00:36.273 ******** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Friday 03 October 2025 13:13:26 +0000 (0:00:00.025) 0:00:36.298 ******** skipping: [instance] TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** Friday 03 October 2025 13:13:26 +0000 (0:00:00.023) 0:00:36.321 ******** skipping: [instance] TASK [ci_nmstate : Initialize NMstates for each instance] ********************** Friday 03 October 2025 13:13:26 +0000 (0:00:00.028) 0:00:36.350 ******** ok: [instance] TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** Friday 03 October 2025 13:13:26 +0000 (0:00:00.039) 0:00:36.389 ******** skipping: [instance] TASK [ci_nmstate : Get k8s nodes] ********************************************** Friday 03 October 2025 13:13:26 +0000 (0:00:00.034) 0:00:36.423 ******** skipping: [instance] TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** Friday 03 October 2025 13:13:26 +0000 (0:00:00.023) 0:00:36.447 ******** ok: [instance] TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* Friday 03 October 2025 13:13:26 +0000 (0:00:00.058) 0:00:36.505 ******** skipping: [instance] TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* Friday 03 October 2025 13:13:26 +0000 (0:00:00.024) 0:00:36.529 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) TASK [ci_nmstate : Ensure we have needed facts] ******************************** Friday 03 October 2025 13:13:26 +0000 (0:00:00.049) 0:00:36.578 ******** ok: [instance -> localhost] TASK [ci_nmstate : Install required packages on localhost] ********************* Friday 03 October 2025 13:13:26 +0000 (0:00:00.330) 0:00:36.909 ******** changed: [instance -> localhost] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Friday 03 October 2025 13:13:32 +0000 (0:00:05.643) 0:00:42.552 ******** changed: [instance] TASK [ci_nmstate : Save nmstate state for localhost] *************************** Friday 03 October 2025 13:13:32 +0000 (0:00:00.202) 0:00:42.755 ******** changed: [instance] TASK [ci_nmstate : Apply the desidered state on localhost] ********************* Friday 03 October 2025 13:13:32 +0000 (0:00:00.351) 0:00:43.106 ******** changed: [instance -> localhost] TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** Friday 03 October 2025 13:13:34 +0000 (0:00:01.603) 0:00:44.709 ******** changed: [instance] TASK [reproducer : Select right domain] **************************************** Friday 03 October 2025 13:13:34 +0000 (0:00:00.360) 0:00:45.069 ******** ok: [instance] TASK [Create the virtual networks] ********************************************* Friday 03 October 2025 13:13:34 +0000 (0:00:00.029) 0:00:45.099 ******** TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** Friday 03 October 2025 13:13:34 +0000 (0:00:00.113) 0:00:45.212 ******** ok: [instance] TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* Friday 03 October 2025 13:13:34 +0000 (0:00:00.019) 0:00:45.232 ******** ok: [instance] TASK [libvirt_manager : Load file if exists] *********************************** Friday 03 October 2025 13:13:35 +0000 (0:00:00.186) 0:00:45.418 ******** skipping: [instance] TASK [libvirt_manager : Update fact with existing content] ********************* Friday 03 October 2025 13:13:35 +0000 (0:00:00.029) 0:00:45.448 ******** skipping: [instance] TASK [libvirt_manager : Generate VM list] ************************************** Friday 03 October 2025 13:13:35 +0000 (0:00:00.058) 0:00:45.506 ******** ok: [instance] TASK [libvirt_manager : Generate/update mapping all nodes] ********************* Friday 03 October 2025 13:13:35 +0000 (0:00:00.056) 0:00:45.563 ******** ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Append baremetal nodes if needed] ********************** Friday 03 October 2025 13:13:35 +0000 (0:00:00.128) 0:00:45.691 ******** skipping: [instance] TASK [libvirt_manager : Dump MAC mapping] ************************************** Friday 03 October 2025 13:13:35 +0000 (0:00:00.046) 0:00:45.738 ******** changed: [instance] TASK [libvirt_manager : Inject all VMs in the inventory] *********************** Friday 03 October 2025 13:13:35 +0000 (0:00:00.371) 0:00:46.109 ******** changed: [instance] => (item=Adding compute-0 to computes) changed: [instance] => (item=Adding controller-0 to controllers) changed: [instance] => (item=Adding crc-0 to ocps) TASK [networking_mapper : Check for Networking Definition file existence] ****** Friday 03 October 2025 13:13:35 +0000 (0:00:00.118) 0:00:46.228 ******** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Friday 03 October 2025 13:13:36 +0000 (0:00:00.024) 0:00:46.252 ******** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Friday 03 October 2025 13:13:36 +0000 (0:00:00.027) 0:00:46.279 ******** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Friday 03 October 2025 13:13:36 +0000 (0:00:00.023) 0:00:46.303 ******** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Friday 03 October 2025 13:13:36 +0000 (0:00:00.025) 0:00:46.329 ******** ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Friday 03 October 2025 13:13:36 +0000 (0:00:00.020) 0:00:46.350 ******** ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Friday 03 October 2025 13:13:36 +0000 (0:00:00.078) 0:00:46.428 ******** skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Friday 03 October 2025 13:13:36 +0000 (0:00:00.018) 0:00:46.446 ******** changed: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Friday 03 October 2025 13:13:36 +0000 (0:00:00.208) 0:00:46.654 ******** changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Friday 03 October 2025 13:13:36 +0000 (0:00:00.403) 0:00:47.058 ******** ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Friday 03 October 2025 13:13:36 +0000 (0:00:00.061) 0:00:47.120 ******** ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Friday 03 October 2025 13:13:36 +0000 (0:00:00.033) 0:00:47.153 ******** changed: [instance] TASK [libvirt_manager : Manage networks if needed] ***************************** Friday 03 October 2025 13:13:37 +0000 (0:00:00.387) 0:00:47.540 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** Friday 03 October 2025 13:13:37 +0000 (0:00:00.078) 0:00:47.619 ******** ok: [instance] => (item=public) ok: [instance] => (item=osp_trunk) TASK [libvirt_manager : Ensure networks are defined] *************************** Friday 03 October 2025 13:13:37 +0000 (0:00:00.050) 0:00:47.670 ******** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are created/started] ******************* Friday 03 October 2025 13:13:37 +0000 (0:00:00.445) 0:00:48.116 ******** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are active] **************************** Friday 03 October 2025 13:13:38 +0000 (0:00:00.574) 0:00:48.691 ******** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** Friday 03 October 2025 13:13:38 +0000 (0:00:00.429) 0:00:49.120 ******** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** Friday 03 October 2025 13:13:39 +0000 (0:00:00.429) 0:00:49.550 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance TASK [libvirt_manager : Fetch present bridge interfaces] *********************** Friday 03 October 2025 13:13:39 +0000 (0:00:00.057) 0:00:49.607 ******** ok: [instance] TASK [libvirt_manager : Fetch bridges ports link info] ************************* Friday 03 October 2025 13:13:39 +0000 (0:00:00.182) 0:00:49.790 ******** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [Create dummy interfaces to ensure bridges are UP] ************************ Friday 03 October 2025 13:13:39 +0000 (0:00:00.388) 0:00:50.178 ******** TASK [ci_nmstate : Ensure we have needed facts] ******************************** Friday 03 October 2025 13:13:39 +0000 (0:00:00.067) 0:00:50.246 ******** skipping: [instance] TASK [ci_nmstate : Install required packages on instance] ********************** Friday 03 October 2025 13:13:40 +0000 (0:00:00.036) 0:00:50.282 ******** ok: [instance] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Friday 03 October 2025 13:13:41 +0000 (0:00:01.273) 0:00:51.555 ******** ok: [instance] TASK [ci_nmstate : Save nmstate state for instance] **************************** Friday 03 October 2025 13:13:41 +0000 (0:00:00.215) 0:00:51.771 ******** changed: [instance] TASK [ci_nmstate : Apply the desidered state on instance] ********************** Friday 03 October 2025 13:13:41 +0000 (0:00:00.374) 0:00:52.145 ******** changed: [instance] TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* Friday 03 October 2025 13:13:43 +0000 (0:00:01.618) 0:00:53.763 ******** changed: [instance] TASK [Create extra network configuration] ************************************** Friday 03 October 2025 13:13:43 +0000 (0:00:00.357) 0:00:54.121 ******** skipping: [instance] TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** Friday 03 October 2025 13:13:43 +0000 (0:00:00.032) 0:00:54.154 ******** skipping: [instance] TASK [libvirt_manager : Refresh networking facts on host] ********************** Friday 03 October 2025 13:13:43 +0000 (0:00:00.029) 0:00:54.183 ******** ok: [instance] TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** Friday 03 October 2025 13:13:44 +0000 (0:00:00.435) 0:00:54.619 ******** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [dnsmasq : Install needed packages] *************************************** Friday 03 October 2025 13:13:44 +0000 (0:00:00.148) 0:00:54.768 ******** ok: [instance] TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** Friday 03 October 2025 13:13:45 +0000 (0:00:01.246) 0:00:56.014 ******** changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) TASK [dnsmasq : Manage configuration directory] ******************************** Friday 03 October 2025 13:13:49 +0000 (0:00:03.907) 0:00:59.921 ******** changed: [instance] TASK [dnsmasq : Manage systemd unit file] ************************************** Friday 03 October 2025 13:13:49 +0000 (0:00:00.257) 0:01:00.179 ******** changed: [instance] TASK [dnsmasq : Manage base configuration file] ******************************** Friday 03 October 2025 13:13:50 +0000 (0:00:00.402) 0:01:00.581 ******** changed: [instance] TASK [dnsmasq : Render listener configuration] ********************************* Friday 03 October 2025 13:13:50 +0000 (0:00:00.416) 0:01:00.998 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance TASK [dnsmasq : Create listener configuration file] **************************** Friday 03 October 2025 13:13:50 +0000 (0:00:00.032) 0:01:01.031 ******** changed: [instance] TASK [dnsmasq : Remove listener configuration file] **************************** Friday 03 October 2025 13:13:51 +0000 (0:00:00.418) 0:01:01.449 ******** skipping: [instance] TASK [dnsmasq : Render dns configuration] ************************************** Friday 03 October 2025 13:13:51 +0000 (0:00:00.022) 0:01:01.471 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance TASK [dnsmasq : Create dns configuration file] ********************************* Friday 03 October 2025 13:13:51 +0000 (0:00:00.035) 0:01:01.507 ******** changed: [instance] TASK [dnsmasq : Remove dns configuration file] ********************************* Friday 03 October 2025 13:13:51 +0000 (0:00:00.420) 0:01:01.928 ******** skipping: [instance] TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** Friday 03 October 2025 13:13:51 +0000 (0:00:00.018) 0:01:01.946 ******** ok: [instance] => (item=127.0.0.2) TASK [dnsmasq : Enable and start service] ************************************** Friday 03 October 2025 13:13:51 +0000 (0:00:00.218) 0:01:02.164 ******** changed: [instance] TASK [dnsmasq : Stop service] ************************************************** Friday 03 October 2025 13:13:52 +0000 (0:00:00.699) 0:01:02.864 ******** skipping: [instance] TASK [dnsmasq : Remove unit file] ********************************************** Friday 03 October 2025 13:13:52 +0000 (0:00:00.020) 0:01:02.884 ******** skipping: [instance] TASK [dnsmasq : Remove main configuration files] ******************************* Friday 03 October 2025 13:13:52 +0000 (0:00:00.020) 0:01:02.904 ******** skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) skipping: [instance] TASK [Create dnsmasq networks] ************************************************* Friday 03 October 2025 13:13:52 +0000 (0:00:00.030) 0:01:02.935 ******** TASK [dnsmasq : Assert mandatory parameter] ************************************ Friday 03 October 2025 13:13:52 +0000 (0:00:00.116) 0:01:03.052 ******** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Friday 03 October 2025 13:13:52 +0000 (0:00:00.055) 0:01:03.107 ******** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Friday 03 October 2025 13:13:52 +0000 (0:00:00.038) 0:01:03.145 ******** changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Friday 03 October 2025 13:13:53 +0000 (0:00:00.445) 0:01:03.591 ******** skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Friday 03 October 2025 13:13:53 +0000 (0:00:00.019) 0:01:03.611 ******** skipping: [instance] TASK [dnsmasq : Assert mandatory parameter] ************************************ Friday 03 October 2025 13:13:53 +0000 (0:00:00.025) 0:01:03.637 ******** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Friday 03 October 2025 13:13:53 +0000 (0:00:00.030) 0:01:03.667 ******** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Friday 03 October 2025 13:13:53 +0000 (0:00:00.043) 0:01:03.710 ******** changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Friday 03 October 2025 13:13:53 +0000 (0:00:00.449) 0:01:04.159 ******** skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Friday 03 October 2025 13:13:53 +0000 (0:00:00.029) 0:01:04.189 ******** skipping: [instance] TASK [libvirt_manager : Ensure network is in correct zone] ********************* Friday 03 October 2025 13:13:53 +0000 (0:00:00.033) 0:01:04.222 ******** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Friday 03 October 2025 13:13:54 +0000 (0:00:00.492) 0:01:04.715 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Friday 03 October 2025 13:13:54 +0000 (0:00:00.036) 0:01:04.751 ******** ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Friday 03 October 2025 13:13:54 +0000 (0:00:00.350) 0:01:05.101 ******** ok: [instance] TASK [libvirt_manager : Extract IP address from network bridges] *************** Friday 03 October 2025 13:13:54 +0000 (0:00:00.038) 0:01:05.140 ******** ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Friday 03 October 2025 13:13:55 +0000 (0:00:00.215) 0:01:05.356 ******** ok: [instance] TASK [libvirt_manager : Output _network_data] ********************************** Friday 03 October 2025 13:13:55 +0000 (0:00:00.042) 0:01:05.398 ******** changed: [instance] TASK [libvirt_manager : Output pub_net] **************************************** Friday 03 October 2025 13:13:55 +0000 (0:00:00.345) 0:01:05.744 ******** changed: [instance] TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** Friday 03 October 2025 13:13:55 +0000 (0:00:00.335) 0:01:06.080 ******** changed: [instance] TASK [libvirt_manager : Expose patch for networking_mapper] ******************** Friday 03 October 2025 13:13:56 +0000 (0:00:00.341) 0:01:06.421 ******** ok: [instance] TASK [libvirt_manager : Save networking_mapper patch] ************************** Friday 03 October 2025 13:13:56 +0000 (0:00:00.097) 0:01:06.519 ******** changed: [instance] TASK [networking_mapper : Check for Networking Definition file existence] ****** Friday 03 October 2025 13:13:56 +0000 (0:00:00.365) 0:01:06.885 ******** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Friday 03 October 2025 13:13:56 +0000 (0:00:00.027) 0:01:06.912 ******** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Friday 03 October 2025 13:13:56 +0000 (0:00:00.026) 0:01:06.938 ******** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Friday 03 October 2025 13:13:56 +0000 (0:00:00.026) 0:01:06.965 ******** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Friday 03 October 2025 13:13:56 +0000 (0:00:00.026) 0:01:06.992 ******** ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Friday 03 October 2025 13:13:56 +0000 (0:00:00.021) 0:01:07.013 ******** ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Friday 03 October 2025 13:13:56 +0000 (0:00:00.089) 0:01:07.102 ******** skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Friday 03 October 2025 13:13:56 +0000 (0:00:00.020) 0:01:07.123 ******** ok: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Friday 03 October 2025 13:13:57 +0000 (0:00:00.219) 0:01:07.342 ******** changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Friday 03 October 2025 13:13:57 +0000 (0:00:00.434) 0:01:07.777 ******** ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Friday 03 October 2025 13:13:57 +0000 (0:00:00.076) 0:01:07.853 ******** ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Friday 03 October 2025 13:13:57 +0000 (0:00:00.037) 0:01:07.891 ******** changed: [instance] TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** Friday 03 October 2025 13:13:58 +0000 (0:00:00.467) 0:01:08.358 ******** ok: [instance] TASK [libvirt_manager : Unset patch] ******************************************* Friday 03 October 2025 13:13:58 +0000 (0:00:00.030) 0:01:08.389 ******** ok: [instance] TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** Friday 03 October 2025 13:13:58 +0000 (0:00:00.029) 0:01:08.419 ******** ok: [instance] TASK [libvirt_manager : Reserve IPs on networks] ******************************* Friday 03 October 2025 13:13:58 +0000 (0:00:00.022) 0:01:08.441 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) TASK [libvirt_manager : Loop on host IPs] ************************************** Friday 03 October 2025 13:13:58 +0000 (0:00:00.081) 0:01:08.523 ******** ok: [instance] => (item=compute-0 - ctlplane) ok: [instance] => (item=controller-0 - ctlplane) ok: [instance] => (item=crc-0 - ctlplane) TASK [libvirt_manager : Loop on host IPs] ************************************** Friday 03 October 2025 13:13:58 +0000 (0:00:00.136) 0:01:08.659 ******** skipping: [instance] => (item=compute-0 - internalapi) skipping: [instance] => (item=controller-0 - internalapi) skipping: [instance] => (item=crc-0 - internalapi) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Friday 03 October 2025 13:13:58 +0000 (0:00:00.087) 0:01:08.747 ******** skipping: [instance] => (item=compute-0 - storage) skipping: [instance] => (item=controller-0 - storage) skipping: [instance] => (item=crc-0 - storage) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Friday 03 October 2025 13:13:58 +0000 (0:00:00.088) 0:01:08.836 ******** skipping: [instance] => (item=compute-0 - tenant) skipping: [instance] => (item=controller-0 - tenant) skipping: [instance] => (item=crc-0 - tenant) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Friday 03 October 2025 13:13:58 +0000 (0:00:00.134) 0:01:08.971 ******** skipping: [instance] => (item=compute-0 - external) skipping: [instance] => (item=controller-0 - external) skipping: [instance] => (item=crc-0 - external) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Friday 03 October 2025 13:13:58 +0000 (0:00:00.090) 0:01:09.061 ******** skipping: [instance] => (item=compute-0 - storagemgmt) skipping: [instance] => (item=controller-0 - storagemgmt) skipping: [instance] => (item=crc-0 - storagemgmt) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Friday 03 October 2025 13:13:58 +0000 (0:00:00.093) 0:01:09.154 ******** ok: [instance] => (item=compute-0 - public) ok: [instance] => (item=controller-0 - public) ok: [instance] => (item=crc-0 - public) TASK [Inject DHCP entries for net {{ net_name }}] ****************************** Friday 03 October 2025 13:13:59 +0000 (0:00:00.178) 0:01:09.333 ******** TASK [dnsmasq : Ensure we have the right data and type] ************************ Friday 03 October 2025 13:13:59 +0000 (0:00:00.116) 0:01:09.449 ******** ok: [instance] TASK [dnsmasq : Assert we have needed host data] ******************************* Friday 03 October 2025 13:13:59 +0000 (0:00:00.045) 0:01:09.495 ******** ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:dd:d9:74', 'ips': ['192.168.140.100', '']}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:8f:cc:1e', 'ips': ['192.168.140.9', '']}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:f0:13:6c', 'ips': ['192.168.140.10', '']}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ba:1c:e6', 'ips': ['192.168.101.100', '']}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:9e:c4:8c', 'ips': ['192.168.101.9', '']}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:d7:64:65', 'ips': ['192.168.101.10', '']}) TASK [dnsmasq : Ensure networks exists] **************************************** Friday 03 October 2025 13:13:59 +0000 (0:00:00.101) 0:01:09.596 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) TASK [dnsmasq : Check network file status] ************************************* Friday 03 October 2025 13:13:59 +0000 (0:00:00.053) 0:01:09.649 ******** ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Friday 03 October 2025 13:13:59 +0000 (0:00:00.181) 0:01:09.831 ******** ok: [instance] TASK [dnsmasq : Check network file status] ************************************* Friday 03 October 2025 13:13:59 +0000 (0:00:00.024) 0:01:09.856 ******** ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Friday 03 October 2025 13:13:59 +0000 (0:00:00.185) 0:01:10.042 ******** ok: [instance] TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** Friday 03 October 2025 13:13:59 +0000 (0:00:00.025) 0:01:10.067 ******** ok: [instance] TASK [dnsmasq : Compute entry] ************************************************* Friday 03 October 2025 13:13:59 +0000 (0:00:00.023) 0:01:10.090 ******** ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:dd:d9:74', 'ips': ['192.168.140.100', '']}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:8f:cc:1e', 'ips': ['192.168.140.9', '']}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:f0:13:6c', 'ips': ['192.168.140.10', '']}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ba:1c:e6', 'ips': ['192.168.101.100', '']}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:9e:c4:8c', 'ips': ['192.168.101.9', '']}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:d7:64:65', 'ips': ['192.168.101.10', '']}) TASK [dnsmasq : Create add/remove sets] **************************************** Friday 03 October 2025 13:14:00 +0000 (0:00:00.185) 0:01:10.275 ******** ok: [instance] TASK [dnsmasq : Add DHCP entries] ********************************************** Friday 03 October 2025 13:14:00 +0000 (0:00:00.041) 0:01:10.316 ******** changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:dd:d9:74', 'entry': '52:54:00:dd:d9:74,192.168.140.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:8f:cc:1e', 'entry': '52:54:01:8f:cc:1e,192.168.140.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:f0:13:6c', 'entry': '52:54:02:f0:13:6c,192.168.140.10,crc-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_compute-0_52:54:00:ba:1c:e6', 'entry': '52:54:00:ba:1c:e6,192.168.101.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_controller-0_52:54:01:9e:c4:8c', 'entry': '52:54:01:9e:c4:8c,192.168.101.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_crc-0_52:54:02:d7:64:65', 'entry': '52:54:02:d7:64:65,192.168.101.10,crc-0', 'state': 'present'}) TASK [dnsmasq : Remove DHCP entries] ******************************************* Friday 03 October 2025 13:14:02 +0000 (0:00:02.102) 0:01:12.419 ******** skipping: [instance] TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** Friday 03 October 2025 13:14:02 +0000 (0:00:00.023) 0:01:12.443 ******** ok: [instance] => (item=compute-0) ok: [instance] => (item=controller-0) ok: [instance] => (item=crc-0) TASK [Inject VMs in the .utility zone] ***************************************** Friday 03 October 2025 13:14:02 +0000 (0:00:00.229) 0:01:12.673 ******** TASK [dnsmasq : Assert we have needed host record data] ************************ Friday 03 October 2025 13:14:02 +0000 (0:00:00.124) 0:01:12.798 ******** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Friday 03 October 2025 13:14:02 +0000 (0:00:00.042) 0:01:12.840 ******** ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Friday 03 October 2025 13:14:02 +0000 (0:00:00.214) 0:01:13.054 ******** changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [libvirt_manager : Ensure some domains are local] ************************* Friday 03 October 2025 13:14:06 +0000 (0:00:03.339) 0:01:16.394 ******** changed: [instance] TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ Friday 03 October 2025 13:14:06 +0000 (0:00:00.386) 0:01:16.780 ******** RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Friday 03 October 2025 13:14:06 +0000 (0:00:00.011) 0:01:16.791 ******** changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Friday 03 October 2025 13:14:07 +0000 (0:00:00.859) 0:01:17.651 ******** changed: [instance] RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* Friday 03 October 2025 13:14:07 +0000 (0:00:00.356) 0:01:18.007 ******** changed: [instance] TASK [reproducer : Delegate our domains to our own instance] ******************* Friday 03 October 2025 13:14:08 +0000 (0:00:00.353) 0:01:18.360 ******** changed: [instance] TASK [reproducer : Ensure "utility" domain is local] *************************** Friday 03 October 2025 13:14:08 +0000 (0:00:00.371) 0:01:18.732 ******** changed: [instance] TASK [Build utility records dataset] ******************************************* Friday 03 October 2025 13:14:08 +0000 (0:00:00.380) 0:01:19.113 ******** TASK [dnsmasq : Assert we have needed host record data] ************************ Friday 03 October 2025 13:14:08 +0000 (0:00:00.032) 0:01:19.145 ******** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Friday 03 October 2025 13:14:08 +0000 (0:00:00.094) 0:01:19.239 ******** ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Friday 03 October 2025 13:14:09 +0000 (0:00:00.101) 0:01:19.341 ******** changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [reproducer : Flush handlers] ********************************************* Friday 03 October 2025 13:14:09 +0000 (0:00:00.490) 0:01:19.831 ******** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Friday 03 October 2025 13:14:09 +0000 (0:00:00.010) 0:01:19.842 ******** changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Friday 03 October 2025 13:14:10 +0000 (0:00:00.504) 0:01:20.347 ******** changed: [instance] TASK [reproducer : Bootstrap nat64 if needed] ********************************** Friday 03 October 2025 13:14:10 +0000 (0:00:00.363) 0:01:20.710 ******** skipping: [instance] TASK [reproducer : Deploy CRC if needed] *************************************** Friday 03 October 2025 13:14:10 +0000 (0:00:00.032) 0:01:20.743 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance TASK [reproducer : Check for CRC availability in known path] ******************* Friday 03 October 2025 13:14:10 +0000 (0:00:00.078) 0:01:20.822 ******** ok: [instance] TASK [Deploy CRC if needed] **************************************************** Friday 03 October 2025 13:14:10 +0000 (0:00:00.196) 0:01:21.019 ******** skipping: [instance] TASK [rhol_crc : Stop CRC VM] ************************************************** Friday 03 October 2025 13:14:10 +0000 (0:00:00.019) 0:01:21.039 ******** ok: [instance] TASK [rhol_crc : Undefine CRC VM] ********************************************** Friday 03 October 2025 13:14:11 +0000 (0:00:00.355) 0:01:21.394 ******** ok: [instance] TASK [rhol_crc : Destroy CRC network] ****************************************** Friday 03 October 2025 13:14:11 +0000 (0:00:00.239) 0:01:21.633 ******** ok: [instance] TASK [rhol_crc : Undefine CRC network] ***************************************** Friday 03 October 2025 13:14:11 +0000 (0:00:00.234) 0:01:21.867 ******** ok: [instance] TASK [rhol_crc : Destroy default network] ************************************** Friday 03 October 2025 13:14:11 +0000 (0:00:00.228) 0:01:22.096 ******** ok: [instance] TASK [Check if new ssh keypair exists] ***************************************** Friday 03 October 2025 13:14:12 +0000 (0:00:00.227) 0:01:22.323 ******** TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Friday 03 October 2025 13:14:12 +0000 (0:00:00.043) 0:01:22.366 ******** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Friday 03 October 2025 13:14:12 +0000 (0:00:00.197) 0:01:22.564 ******** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Friday 03 October 2025 13:14:12 +0000 (0:00:00.022) 0:01:22.586 ******** skipping: [instance] TASK [reproducer : Slurp ssh key for CRC access] ******************************* Friday 03 October 2025 13:14:12 +0000 (0:00:00.025) 0:01:22.611 ******** ok: [instance] TASK [reproducer : Get kubeconfig file from crc directory] ********************* Friday 03 October 2025 13:14:12 +0000 (0:00:00.293) 0:01:22.905 ******** ok: [instance] TASK [reproducer : Get kubeadmin-password file from crc directory] ************* Friday 03 October 2025 13:14:12 +0000 (0:00:00.223) 0:01:23.128 ******** ok: [instance] TASK [Ensure we expose openshift_login related facts] ************************** Friday 03 October 2025 13:14:13 +0000 (0:00:00.177) 0:01:23.306 ******** TASK [openshift_login : Assert we have needed parameters] ********************** Friday 03 October 2025 13:14:13 +0000 (0:00:00.058) 0:01:23.365 ******** ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Stat kubeconfig] *************************************** Friday 03 October 2025 13:14:13 +0000 (0:00:00.044) 0:01:23.409 ******** ok: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Friday 03 October 2025 13:14:13 +0000 (0:00:00.182) 0:01:23.592 ******** ok: [instance] TASK [openshift_login : Assert files exist] ************************************ Friday 03 October 2025 13:14:13 +0000 (0:00:00.189) 0:01:23.782 ******** ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Gather the password of the deployed cluster.] ********** Friday 03 October 2025 13:14:13 +0000 (0:00:00.023) 0:01:23.806 ******** ok: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Friday 03 October 2025 13:14:13 +0000 (0:00:00.189) 0:01:23.995 ******** ok: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Friday 03 October 2025 13:14:13 +0000 (0:00:00.177) 0:01:24.172 ******** ok: [instance] TASK [reproducer : Remove CRC managed zone delegation] ************************* Friday 03 October 2025 13:14:13 +0000 (0:00:00.047) 0:01:24.220 ******** changed: [instance] => (item=dnsmasq.d/crc.conf) changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ Friday 03 October 2025 13:14:14 +0000 (0:00:00.382) 0:01:24.603 ******** skipping: [instance] TASK [Load the architecture local kustomize patches] *************************** Friday 03 October 2025 13:14:14 +0000 (0:00:00.018) 0:01:24.621 ******** skipping: [instance] TASK [reproducer : Consume libvirt_manager] ************************************ Friday 03 October 2025 13:14:14 +0000 (0:00:00.023) 0:01:24.645 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance TASK [libvirt_manager : Import layout generator if needed] ********************* Friday 03 October 2025 13:14:14 +0000 (0:00:00.134) 0:01:24.779 ******** skipping: [instance] TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** Friday 03 October 2025 13:14:14 +0000 (0:00:00.024) 0:01:24.804 ******** changed: [instance] TASK [libvirt_manager : Enable masquerading for public traffic] **************** Friday 03 October 2025 13:14:14 +0000 (0:00:00.406) 0:01:25.210 ******** changed: [instance] TASK [libvirt_manager : Ensure firewalld is restarts] ************************** Friday 03 October 2025 13:14:15 +0000 (0:00:00.511) 0:01:25.721 ******** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Friday 03 October 2025 13:14:15 +0000 (0:00:00.011) 0:01:25.733 ******** changed: [instance] RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Friday 03 October 2025 13:14:15 +0000 (0:00:00.438) 0:01:26.171 ******** changed: [instance] TASK [Deploy virtualbmc] ******************************************************* Friday 03 October 2025 13:14:17 +0000 (0:00:01.871) 0:01:28.042 ******** skipping: [instance] TASK [libvirt_manager : Let the project know we have vbmc available] *********** Friday 03 October 2025 13:14:17 +0000 (0:00:00.033) 0:01:28.075 ******** skipping: [instance] TASK [libvirt_manager : Create needed workload directory] ********************** Friday 03 October 2025 13:14:17 +0000 (0:00:00.032) 0:01:28.108 ******** changed: [instance] => (item=workload) changed: [instance] => (item=reproducer-inventory) ok: [instance] => (item=volumes) TASK [libvirt_manager : Allow QEMU on workload directory] ********************** Friday 03 October 2025 13:14:18 +0000 (0:00:00.568) 0:01:28.677 ******** changed: [instance] => (item=workload) changed: [instance] => (item=volumes) TASK [libvirt_manager : Generate networking data] ****************************** Friday 03 October 2025 13:14:18 +0000 (0:00:00.421) 0:01:29.098 ******** skipping: [instance] TASK [libvirt_manager : Create group inventories] ****************************** Friday 03 October 2025 13:14:18 +0000 (0:00:00.025) 0:01:29.124 ******** changed: [instance] => (item=compute) changed: [instance] => (item=controller) changed: [instance] => (item=crc) TASK [libvirt_manager : Create "all" group inventory file] ********************* Friday 03 October 2025 13:14:19 +0000 (0:00:01.040) 0:01:30.164 ******** changed: [instance] TASK [libvirt_manager : Ensure storage pool is present.] *********************** Friday 03 October 2025 13:14:20 +0000 (0:00:00.383) 0:01:30.547 ******** skipping: [instance] TASK [libvirt_manager : Ensure images are present] ***************************** Friday 03 October 2025 13:14:20 +0000 (0:00:00.039) 0:01:30.587 ******** skipping: [instance] => (item=crc) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) TASK [libvirt_manager : Ensure directory exists] ******************************* Friday 03 October 2025 13:14:20 +0000 (0:00:00.065) 0:01:30.652 ******** changed: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Friday 03 October 2025 13:14:20 +0000 (0:00:00.219) 0:01:30.872 ******** ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Friday 03 October 2025 13:14:20 +0000 (0:00:00.202) 0:01:31.074 ******** changed: [instance] TASK [libvirt_manager : Check image] ******************************************* Friday 03 October 2025 13:14:58 +0000 (0:00:37.799) 0:02:08.873 ******** ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Friday 03 October 2025 13:14:58 +0000 (0:00:00.204) 0:02:09.077 ******** ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Friday 03 October 2025 13:14:58 +0000 (0:00:00.042) 0:02:09.120 ******** changed: [instance] TASK [libvirt_manager : Ensure directory exists] ******************************* Friday 03 October 2025 13:14:59 +0000 (0:00:00.251) 0:02:09.371 ******** ok: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Friday 03 October 2025 13:14:59 +0000 (0:00:00.211) 0:02:09.583 ******** ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Friday 03 October 2025 13:14:59 +0000 (0:00:00.199) 0:02:09.783 ******** skipping: [instance] TASK [libvirt_manager : Check image] ******************************************* Friday 03 October 2025 13:14:59 +0000 (0:00:00.023) 0:02:09.806 ******** ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Friday 03 October 2025 13:14:59 +0000 (0:00:00.202) 0:02:10.009 ******** ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Friday 03 October 2025 13:14:59 +0000 (0:00:00.043) 0:02:10.053 ******** ok: [instance] TASK [libvirt_manager : Get ssh key state] ************************************* Friday 03 October 2025 13:15:00 +0000 (0:00:00.209) 0:02:10.263 ******** ok: [instance] TASK [libvirt_manager : Create temporary ssh keypair] ************************** Friday 03 October 2025 13:15:00 +0000 (0:00:00.185) 0:02:10.448 ******** changed: [instance] TASK [libvirt_manager : Slurp public key for later use] ************************ Friday 03 October 2025 13:15:00 +0000 (0:00:00.413) 0:02:10.861 ******** ok: [instance] TASK [libvirt_manager : Slurp private key for later use] *********************** Friday 03 October 2025 13:15:00 +0000 (0:00:00.184) 0:02:11.045 ******** ok: [instance] TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** Friday 03 October 2025 13:15:00 +0000 (0:00:00.182) 0:02:11.228 ******** changed: [instance] TASK [libvirt_manager : Create fact holding network data for VMs] ************** Friday 03 October 2025 13:15:01 +0000 (0:00:00.416) 0:02:11.645 ******** ok: [instance] TASK [libvirt_manager : List existing networks] ******************************** Friday 03 October 2025 13:15:01 +0000 (0:00:00.022) 0:02:11.668 ******** ok: [instance] TASK [libvirt_manager : Gather pool fact] ************************************** Friday 03 October 2025 13:15:01 +0000 (0:00:00.237) 0:02:11.905 ******** ok: [instance] TASK [libvirt_manager : Create and run VMs] ************************************ Friday 03 October 2025 13:15:02 +0000 (0:00:00.483) 0:02:12.389 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Create VM image for compute-0] ************************* Friday 03 October 2025 13:15:02 +0000 (0:00:00.122) 0:02:12.512 ******** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** Friday 03 October 2025 13:15:02 +0000 (0:00:00.267) 0:02:12.779 ******** changed: [instance] TASK [libvirt_manager : Define VMs for type compute-0] ************************* Friday 03 October 2025 13:15:02 +0000 (0:00:00.233) 0:02:13.013 ******** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** Friday 03 October 2025 13:15:03 +0000 (0:00:00.324) 0:02:13.337 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Friday 03 October 2025 13:15:03 +0000 (0:00:00.031) 0:02:13.369 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Friday 03 October 2025 13:15:03 +0000 (0:00:00.049) 0:02:13.418 ******** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Friday 03 October 2025 13:15:03 +0000 (0:00:00.233) 0:02:13.651 ******** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Friday 03 October 2025 13:15:03 +0000 (0:00:00.044) 0:02:13.696 ******** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Friday 03 October 2025 13:15:03 +0000 (0:00:00.228) 0:02:13.925 ******** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ Friday 03 October 2025 13:15:03 +0000 (0:00:00.200) 0:02:14.125 ******** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Friday 03 October 2025 13:15:04 +0000 (0:00:00.302) 0:02:14.428 ******** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Friday 03 October 2025 13:15:04 +0000 (0:00:00.254) 0:02:14.683 ******** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Friday 03 October 2025 13:15:04 +0000 (0:00:00.052) 0:02:14.735 ******** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Friday 03 October 2025 13:15:04 +0000 (0:00:00.245) 0:02:14.980 ******** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* Friday 03 October 2025 13:15:04 +0000 (0:00:00.208) 0:02:15.189 ******** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** Friday 03 October 2025 13:15:05 +0000 (0:00:00.289) 0:02:15.479 ******** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** Friday 03 October 2025 13:15:05 +0000 (0:00:00.021) 0:02:15.500 ******** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** Friday 03 October 2025 13:15:05 +0000 (0:00:00.028) 0:02:15.528 ******** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** Friday 03 October 2025 13:15:05 +0000 (0:00:00.028) 0:02:15.556 ******** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Friday 03 October 2025 13:15:05 +0000 (0:00:00.026) 0:02:15.583 ******** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Friday 03 October 2025 13:15:05 +0000 (0:00:00.225) 0:02:15.808 ******** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Friday 03 October 2025 13:15:05 +0000 (0:00:00.037) 0:02:15.846 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Friday 03 October 2025 13:15:05 +0000 (0:00:00.056) 0:02:15.903 ******** ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Friday 03 October 2025 13:15:05 +0000 (0:00:00.207) 0:02:16.110 ******** ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Friday 03 October 2025 13:15:05 +0000 (0:00:00.062) 0:02:16.172 ******** ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Friday 03 October 2025 13:15:05 +0000 (0:00:00.047) 0:02:16.220 ******** skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Friday 03 October 2025 13:15:06 +0000 (0:00:00.044) 0:02:16.264 ******** skipping: [instance] TASK [Call the config_drive role] ********************************************** Friday 03 October 2025 13:15:06 +0000 (0:00:00.042) 0:02:16.307 ******** TASK [config_drive : Ensure needed directories exist] ************************** Friday 03 October 2025 13:15:06 +0000 (0:00:00.060) 0:02:16.368 ******** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Friday 03 October 2025 13:15:06 +0000 (0:00:00.465) 0:02:16.833 ******** ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Friday 03 October 2025 13:15:07 +0000 (0:00:01.259) 0:02:18.092 ******** changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Friday 03 October 2025 13:15:08 +0000 (0:00:00.231) 0:02:18.324 ******** changed: [instance] TASK [config_drive : Generate user-data] *************************************** Friday 03 October 2025 13:15:08 +0000 (0:00:00.385) 0:02:18.710 ******** changed: [instance] TASK [config_drive : Generate network-data] ************************************ Friday 03 October 2025 13:15:08 +0000 (0:00:00.395) 0:02:19.105 ******** skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Friday 03 October 2025 13:15:08 +0000 (0:00:00.046) 0:02:19.152 ******** ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Friday 03 October 2025 13:15:09 +0000 (0:00:00.212) 0:02:19.364 ******** skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Friday 03 October 2025 13:15:09 +0000 (0:00:00.043) 0:02:19.408 ******** Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Friday 03 October 2025 13:15:09 +0000 (0:00:00.241) 0:02:19.649 ******** changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Friday 03 October 2025 13:15:09 +0000 (0:00:00.285) 0:02:19.935 ******** skipping: [instance] TASK [libvirt_manager : Create VM image for controller-0] ********************** Friday 03 October 2025 13:15:09 +0000 (0:00:00.047) 0:02:19.983 ******** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** Friday 03 October 2025 13:15:09 +0000 (0:00:00.249) 0:02:20.233 ******** changed: [instance] TASK [libvirt_manager : Define VMs for type controller-0] ********************** Friday 03 October 2025 13:15:10 +0000 (0:00:00.232) 0:02:20.466 ******** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** Friday 03 October 2025 13:15:10 +0000 (0:00:00.307) 0:02:20.774 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Friday 03 October 2025 13:15:10 +0000 (0:00:00.030) 0:02:20.804 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Friday 03 October 2025 13:15:10 +0000 (0:00:00.047) 0:02:20.852 ******** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Friday 03 October 2025 13:15:10 +0000 (0:00:00.240) 0:02:21.092 ******** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Friday 03 October 2025 13:15:10 +0000 (0:00:00.048) 0:02:21.141 ******** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Friday 03 October 2025 13:15:11 +0000 (0:00:00.243) 0:02:21.385 ******** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* Friday 03 October 2025 13:15:11 +0000 (0:00:00.212) 0:02:21.597 ******** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Friday 03 October 2025 13:15:12 +0000 (0:00:01.291) 0:02:22.888 ******** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Friday 03 October 2025 13:15:12 +0000 (0:00:00.236) 0:02:23.124 ******** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Friday 03 October 2025 13:15:12 +0000 (0:00:00.044) 0:02:23.169 ******** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Friday 03 October 2025 13:15:13 +0000 (0:00:00.235) 0:02:23.405 ******** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** Friday 03 October 2025 13:15:13 +0000 (0:00:00.209) 0:02:23.614 ******** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** Friday 03 October 2025 13:15:13 +0000 (0:00:00.300) 0:02:23.915 ******** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** Friday 03 October 2025 13:15:13 +0000 (0:00:00.022) 0:02:23.937 ******** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** Friday 03 October 2025 13:15:13 +0000 (0:00:00.029) 0:02:23.966 ******** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** Friday 03 October 2025 13:15:13 +0000 (0:00:00.030) 0:02:23.997 ******** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Friday 03 October 2025 13:15:13 +0000 (0:00:00.027) 0:02:24.024 ******** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Friday 03 October 2025 13:15:14 +0000 (0:00:00.228) 0:02:24.253 ******** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Friday 03 October 2025 13:15:14 +0000 (0:00:00.038) 0:02:24.291 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Friday 03 October 2025 13:15:14 +0000 (0:00:00.055) 0:02:24.347 ******** ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Friday 03 October 2025 13:15:14 +0000 (0:00:00.206) 0:02:24.553 ******** ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Friday 03 October 2025 13:15:14 +0000 (0:00:00.064) 0:02:24.618 ******** ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Friday 03 October 2025 13:15:14 +0000 (0:00:00.047) 0:02:24.665 ******** skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Friday 03 October 2025 13:15:14 +0000 (0:00:00.047) 0:02:24.713 ******** skipping: [instance] TASK [Call the config_drive role] ********************************************** Friday 03 October 2025 13:15:14 +0000 (0:00:00.045) 0:02:24.758 ******** TASK [config_drive : Ensure needed directories exist] ************************** Friday 03 October 2025 13:15:14 +0000 (0:00:00.061) 0:02:24.820 ******** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Friday 03 October 2025 13:15:14 +0000 (0:00:00.427) 0:02:25.248 ******** ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Friday 03 October 2025 13:15:16 +0000 (0:00:01.225) 0:02:26.473 ******** changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Friday 03 October 2025 13:15:16 +0000 (0:00:00.227) 0:02:26.701 ******** changed: [instance] TASK [config_drive : Generate user-data] *************************************** Friday 03 October 2025 13:15:16 +0000 (0:00:00.387) 0:02:27.088 ******** changed: [instance] TASK [config_drive : Generate network-data] ************************************ Friday 03 October 2025 13:15:17 +0000 (0:00:00.385) 0:02:27.473 ******** skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Friday 03 October 2025 13:15:17 +0000 (0:00:00.043) 0:02:27.517 ******** ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Friday 03 October 2025 13:15:17 +0000 (0:00:00.208) 0:02:27.726 ******** skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Friday 03 October 2025 13:15:17 +0000 (0:00:00.043) 0:02:27.770 ******** Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Friday 03 October 2025 13:15:17 +0000 (0:00:00.234) 0:02:28.005 ******** changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Friday 03 October 2025 13:15:18 +0000 (0:00:00.285) 0:02:28.290 ******** skipping: [instance] TASK [libvirt_manager : Create VM image for crc-0] ***************************** Friday 03 October 2025 13:15:18 +0000 (0:00:00.045) 0:02:28.336 ******** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ Friday 03 October 2025 13:15:18 +0000 (0:00:00.254) 0:02:28.590 ******** changed: [instance] TASK [libvirt_manager : Define VMs for type crc-0] ***************************** Friday 03 October 2025 13:15:18 +0000 (0:00:00.237) 0:02:28.828 ******** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** Friday 03 October 2025 13:15:18 +0000 (0:00:00.297) 0:02:29.126 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Friday 03 October 2025 13:15:18 +0000 (0:00:00.028) 0:02:29.154 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Friday 03 October 2025 13:15:18 +0000 (0:00:00.043) 0:02:29.197 ******** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Friday 03 October 2025 13:15:19 +0000 (0:00:00.229) 0:02:29.427 ******** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Friday 03 October 2025 13:15:19 +0000 (0:00:00.047) 0:02:29.475 ******** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Friday 03 October 2025 13:15:19 +0000 (0:00:00.251) 0:02:29.726 ******** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** Friday 03 October 2025 13:15:19 +0000 (0:00:00.215) 0:02:29.942 ******** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Friday 03 October 2025 13:15:20 +0000 (0:00:00.308) 0:02:30.250 ******** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Friday 03 October 2025 13:15:20 +0000 (0:00:00.244) 0:02:30.495 ******** ok: [instance] => (item=cifmw-osp_trunk) ok: [instance] => (item=cifmw-public) TASK [libvirt_manager : Dump domain xml] *************************************** Friday 03 October 2025 13:15:20 +0000 (0:00:00.046) 0:02:30.541 ******** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Friday 03 October 2025 13:15:20 +0000 (0:00:00.245) 0:02:30.787 ******** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* Friday 03 October 2025 13:15:20 +0000 (0:00:00.212) 0:02:31.000 ******** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* Friday 03 October 2025 13:15:21 +0000 (0:00:00.292) 0:02:31.293 ******** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ Friday 03 October 2025 13:15:21 +0000 (0:00:00.022) 0:02:31.315 ******** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** Friday 03 October 2025 13:15:21 +0000 (0:00:00.030) 0:02:31.345 ******** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** Friday 03 October 2025 13:15:21 +0000 (0:00:00.028) 0:02:31.374 ******** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Friday 03 October 2025 13:15:21 +0000 (0:00:00.027) 0:02:31.402 ******** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Friday 03 October 2025 13:15:21 +0000 (0:00:00.228) 0:02:31.630 ******** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Friday 03 October 2025 13:15:21 +0000 (0:00:00.038) 0:02:31.669 ******** skipping: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Friday 03 October 2025 13:15:21 +0000 (0:00:00.028) 0:02:31.697 ******** skipping: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Friday 03 October 2025 13:15:21 +0000 (0:00:00.027) 0:02:31.725 ******** skipping: [instance] TASK [libvirt_manager : Start (power-on) VMs] ********************************** Friday 03 October 2025 13:15:21 +0000 (0:00:00.045) 0:02:31.770 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** Friday 03 October 2025 13:15:21 +0000 (0:00:00.064) 0:02:31.835 ******** ok: [instance] => (item=crc) TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** Friday 03 October 2025 13:15:21 +0000 (0:00:00.249) 0:02:32.084 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Start vm] ********************************************** Friday 03 October 2025 13:15:23 +0000 (0:00:02.074) 0:02:34.158 ******** changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Friday 03 October 2025 13:15:24 +0000 (0:00:00.902) 0:02:35.060 ******** changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Friday 03 October 2025 13:15:25 +0000 (0:00:00.794) 0:02:35.855 ******** changed: [instance] TASK [libvirt_manager : Wait for SSH on started VMs] *************************** Friday 03 October 2025 13:15:26 +0000 (0:00:00.845) 0:02:36.701 ******** changed: [instance] => (item=compute-0.utility) changed: [instance] => (item=controller-0.utility) changed: [instance] => (item=crc-0.utility) TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** Friday 03 October 2025 13:15:27 +0000 (0:00:00.747) 0:02:37.448 ******** FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j842844284853.23754', 'results_file': '/home/zuul/.ansible_async/j842844284853.23754', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j981727462623.23771', 'results_file': '/home/zuul/.ansible_async/j981727462623.23771', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j71822483543.23787', 'results_file': '/home/zuul/.ansible_async/j71822483543.23787', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) TASK [libvirt_manager : Configure managed VMs] ********************************* Friday 03 October 2025 13:15:46 +0000 (0:00:19.740) 0:02:57.189 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [Check if new ssh keypair exists] ***************************************** Friday 03 October 2025 13:15:47 +0000 (0:00:00.113) 0:02:57.302 ******** skipping: [instance] TASK [Push ssh jumper/configuration for compute-0] ***************************** Friday 03 October 2025 13:15:47 +0000 (0:00:00.063) 0:02:57.366 ******** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Friday 03 October 2025 13:15:47 +0000 (0:00:00.040) 0:02:57.407 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Friday 03 October 2025 13:15:47 +0000 (0:00:00.080) 0:02:57.487 ******** changed: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Friday 03 October 2025 13:15:47 +0000 (0:00:00.218) 0:02:57.706 ******** changed: [instance] TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* Friday 03 October 2025 13:15:47 +0000 (0:00:00.218) 0:02:57.925 ******** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** Friday 03 October 2025 13:15:48 +0000 (0:00:00.398) 0:02:58.323 ******** skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Friday 03 October 2025 13:15:48 +0000 (0:00:00.026) 0:02:58.350 ******** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** Friday 03 October 2025 13:15:48 +0000 (0:00:00.028) 0:02:58.378 ******** skipping: [instance] TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** Friday 03 October 2025 13:15:48 +0000 (0:00:00.050) 0:02:58.429 ******** skipping: [instance] TASK [Check if new ssh keypair exists] ***************************************** Friday 03 October 2025 13:15:48 +0000 (0:00:00.049) 0:02:58.478 ******** skipping: [instance] TASK [Push ssh jumper/configuration for controller-0] ************************** Friday 03 October 2025 13:15:48 +0000 (0:00:00.024) 0:02:58.503 ******** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Friday 03 October 2025 13:15:48 +0000 (0:00:00.039) 0:02:58.542 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Friday 03 October 2025 13:15:48 +0000 (0:00:00.079) 0:02:58.622 ******** ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Friday 03 October 2025 13:15:48 +0000 (0:00:00.214) 0:02:58.837 ******** ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** Friday 03 October 2025 13:15:48 +0000 (0:00:00.211) 0:02:59.048 ******** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** Friday 03 October 2025 13:15:49 +0000 (0:00:00.393) 0:02:59.442 ******** skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Friday 03 October 2025 13:15:49 +0000 (0:00:00.029) 0:02:59.472 ******** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts controller-0] ************** Friday 03 October 2025 13:15:49 +0000 (0:00:00.028) 0:02:59.501 ******** changed: [instance -> controller-0.instance] TASK [libvirt_manager : Inject public key on hosts controller-0] *************** Friday 03 October 2025 13:15:50 +0000 (0:00:01.447) 0:03:00.948 ******** changed: [instance -> controller-0.instance] TASK [Check if new ssh keypair exists] ***************************************** Friday 03 October 2025 13:15:51 +0000 (0:00:00.993) 0:03:01.941 ******** TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Friday 03 October 2025 13:15:51 +0000 (0:00:00.041) 0:03:01.983 ******** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Friday 03 October 2025 13:15:51 +0000 (0:00:00.201) 0:03:02.184 ******** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Friday 03 October 2025 13:15:51 +0000 (0:00:00.024) 0:03:02.209 ******** skipping: [instance] TASK [Push ssh jumper/configuration for crc-0] ********************************* Friday 03 October 2025 13:15:51 +0000 (0:00:00.029) 0:03:02.238 ******** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Friday 03 October 2025 13:15:52 +0000 (0:00:00.046) 0:03:02.285 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Friday 03 October 2025 13:15:52 +0000 (0:00:00.078) 0:03:02.363 ******** ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Friday 03 October 2025 13:15:52 +0000 (0:00:00.212) 0:03:02.576 ******** ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** Friday 03 October 2025 13:15:52 +0000 (0:00:00.213) 0:03:02.790 ******** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** Friday 03 October 2025 13:15:52 +0000 (0:00:00.405) 0:03:03.195 ******** changed: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Friday 03 October 2025 13:15:53 +0000 (0:00:00.683) 0:03:03.879 ******** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* Friday 03 October 2025 13:15:53 +0000 (0:00:00.026) 0:03:03.906 ******** skipping: [instance] TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** Friday 03 October 2025 13:15:53 +0000 (0:00:00.044) 0:03:03.950 ******** skipping: [instance] TASK [Create VBMC entity] ****************************************************** Friday 03 October 2025 13:15:53 +0000 (0:00:00.043) 0:03:03.994 ******** skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) skipping: [instance] TASK [libvirt_manager : List running virtual machines.] ************************ Friday 03 October 2025 13:15:53 +0000 (0:00:00.048) 0:03:04.042 ******** ok: [instance] TASK [libvirt_manager : Dump UUIDs] ******************************************** Friday 03 October 2025 13:15:54 +0000 (0:00:00.247) 0:03:04.289 ******** changed: [instance] TASK [Ensure fresh vbmc listing] *********************************************** Friday 03 October 2025 13:15:54 +0000 (0:00:00.368) 0:03:04.657 ******** skipping: [instance] TASK [libvirt_manager : Update vbmc related fact] ****************************** Friday 03 October 2025 13:15:54 +0000 (0:00:00.035) 0:03:04.693 ******** skipping: [instance] TASK [libvirt_manager : Dump vbmc known hosts] ********************************* Friday 03 October 2025 13:15:54 +0000 (0:00:00.035) 0:03:04.728 ******** skipping: [instance] TASK [libvirt_manager : Copy authorized_keys] ********************************** Friday 03 October 2025 13:15:54 +0000 (0:00:00.033) 0:03:04.762 ******** changed: [instance] TASK [libvirt_manager : Enable root access on CRC] ***************************** Friday 03 October 2025 13:15:55 +0000 (0:00:00.645) 0:03:05.407 ******** changed: [instance] TASK [reproducer : Get deployed VM group inventories] ************************** Friday 03 October 2025 13:15:55 +0000 (0:00:00.585) 0:03:05.993 ******** skipping: [instance] TASK [reproducer : Inject remote inventories onto main hypervisor] ************* Friday 03 October 2025 13:15:55 +0000 (0:00:00.045) 0:03:06.039 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) TASK [reproducer : Gather inventories from instance] *************************** Friday 03 October 2025 13:15:55 +0000 (0:00:00.065) 0:03:06.105 ******** skipping: [instance] TASK [reproducer : Gather inventories from compute-0] ************************** Friday 03 October 2025 13:15:55 +0000 (0:00:00.044) 0:03:06.150 ******** skipping: [instance] TASK [reproducer : Gather inventories from controller-0] *********************** Friday 03 October 2025 13:15:55 +0000 (0:00:00.038) 0:03:06.188 ******** skipping: [instance] TASK [reproducer : Gather inventories from crc-0] ****************************** Friday 03 October 2025 13:15:55 +0000 (0:00:00.039) 0:03:06.227 ******** skipping: [instance] TASK [reproducer : Push generated inventory from hypervisor] ******************* Friday 03 October 2025 13:15:56 +0000 (0:00:00.039) 0:03:06.267 ******** changed: [instance] TASK [reproducer : Slurp devscripts private key] ******************************* Friday 03 October 2025 13:15:56 +0000 (0:00:00.623) 0:03:06.891 ******** skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** Friday 03 October 2025 13:15:56 +0000 (0:00:00.034) 0:03:06.925 ******** skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* Friday 03 October 2025 13:15:56 +0000 (0:00:00.032) 0:03:06.957 ******** skipping: [instance] TASK [openshift_login : Assert we have needed parameters] ********************** Friday 03 October 2025 13:15:56 +0000 (0:00:00.032) 0:03:06.990 ******** skipping: [instance] TASK [openshift_login : Stat kubeconfig] *************************************** Friday 03 October 2025 13:15:56 +0000 (0:00:00.034) 0:03:07.024 ******** skipping: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Friday 03 October 2025 13:15:56 +0000 (0:00:00.034) 0:03:07.058 ******** skipping: [instance] TASK [openshift_login : Assert files exist] ************************************ Friday 03 October 2025 13:15:56 +0000 (0:00:00.041) 0:03:07.100 ******** skipping: [instance] TASK [openshift_login : Gather the password of the deployed cluster.] ********** Friday 03 October 2025 13:15:56 +0000 (0:00:00.037) 0:03:07.137 ******** skipping: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Friday 03 October 2025 13:15:56 +0000 (0:00:00.035) 0:03:07.172 ******** skipping: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Friday 03 October 2025 13:15:56 +0000 (0:00:00.033) 0:03:07.206 ******** skipping: [instance] TASK [reproducer : Set fact for later wait on OCP cluster] ********************* Friday 03 October 2025 13:15:57 +0000 (0:00:00.043) 0:03:07.249 ******** skipping: [instance] TASK [reproducer : Configure Controller node] ********************************** Friday 03 October 2025 13:15:57 +0000 (0:00:00.030) 0:03:07.279 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance TASK [reproducer : Set facts related to the reproducer] ************************ Friday 03 October 2025 13:15:57 +0000 (0:00:00.193) 0:03:07.473 ******** ok: [instance] TASK [reproducer : Ensure directories exist] *********************************** Friday 03 October 2025 13:15:57 +0000 (0:00:00.033) 0:03:07.506 ******** changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Tweak dnf configuration] ************************************ Friday 03 October 2025 13:15:58 +0000 (0:00:01.308) 0:03:08.815 ******** skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Friday 03 October 2025 13:15:58 +0000 (0:00:00.018) 0:03:08.833 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Friday 03 October 2025 13:15:59 +0000 (0:00:00.614) 0:03:09.447 ******** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Friday 03 October 2025 13:15:59 +0000 (0:00:00.033) 0:03:09.481 ******** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Friday 03 October 2025 13:15:59 +0000 (0:00:00.034) 0:03:09.516 ******** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Friday 03 October 2025 13:15:59 +0000 (0:00:00.034) 0:03:09.551 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get rhos-release] ******************************************* Friday 03 October 2025 13:16:00 +0000 (0:00:01.597) 0:03:11.149 ******** skipping: [instance] TASK [reproducer : Install repos] ********************************************** Friday 03 October 2025 13:16:00 +0000 (0:00:00.036) 0:03:11.185 ******** skipping: [instance] TASK [reproducer : Run custom commands after rhos-release setup] *************** Friday 03 October 2025 13:16:00 +0000 (0:00:00.034) 0:03:11.219 ******** skipping: [instance] TASK [reproducer : Create bundle for CRC] ************************************** Friday 03 October 2025 13:16:01 +0000 (0:00:00.036) 0:03:11.256 ******** skipping: [instance] TASK [reproducer : Install some tools] ***************************************** Friday 03 October 2025 13:16:01 +0000 (0:00:00.037) 0:03:11.294 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject command aliases for faster debugging] **************** Friday 03 October 2025 13:16:02 +0000 (0:00:01.084) 0:03:12.378 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Build job inventory for hook usage] ************************* Friday 03 October 2025 13:16:03 +0000 (0:00:01.105) 0:03:13.483 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Push the MAC mapping data] ********************************** Friday 03 October 2025 13:16:03 +0000 (0:00:00.619) 0:03:14.103 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject other Hypervisor SSH keys] *************************** Friday 03 October 2025 13:16:04 +0000 (0:00:00.970) 0:03:15.073 ******** changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** Friday 03 October 2025 13:16:05 +0000 (0:00:01.071) 0:03:16.145 ******** changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject SSH configuration] *********************************** Friday 03 October 2025 13:16:06 +0000 (0:00:00.663) 0:03:16.809 ******** skipping: [instance] => (item=instance) changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) TASK [reproducer : Create kube directory] ************************************** Friday 03 October 2025 13:16:08 +0000 (0:00:01.675) 0:03:18.484 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeconfig content] ********************************** Friday 03 October 2025 13:16:08 +0000 (0:00:00.565) 0:03:19.049 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeadmin-password if exists] ************************ Friday 03 October 2025 13:16:09 +0000 (0:00:00.971) 0:03:20.021 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject devscripts private key if set] *********************** Friday 03 October 2025 13:16:10 +0000 (0:00:00.909) 0:03:20.931 ******** skipping: [instance] TASK [reproducer : Ensure /etc/ci/env is created] ****************************** Friday 03 October 2025 13:16:10 +0000 (0:00:00.032) 0:03:20.964 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Ensure directory tree exist] **************************** Friday 03 October 2025 13:16:11 +0000 (0:00:00.543) 0:03:21.507 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Assert we get needed data] ****************************** Friday 03 October 2025 13:16:11 +0000 (0:00:00.549) 0:03:22.057 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Push reproducer secrets] ******************************** Friday 03 October 2025 13:16:11 +0000 (0:00:00.039) 0:03:22.097 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) TASK [manage_secrets : Debug _secret_dest] ************************************* Friday 03 October 2025 13:16:11 +0000 (0:00:00.062) 0:03:22.160 ******** ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt TASK [manage_secrets : Debug _secret_file] ************************************* Friday 03 October 2025 13:16:11 +0000 (0:00:00.046) 0:03:22.207 ******** ok: [instance -> controller-0(controller-0.instance)] => _secret_file: '' TASK [manage_secrets : Debug _secret_content] ********************************** Friday 03 October 2025 13:16:12 +0000 (0:00:00.050) 0:03:22.257 ******** ok: [instance -> controller-0(controller-0.instance)] => _secret_content: my-default-location-place TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Friday 03 October 2025 13:16:12 +0000 (0:00:00.050) 0:03:22.307 ******** skipping: [instance] TASK [manage_secrets : Check if pull secret src file exists] ******************* Friday 03 October 2025 13:16:12 +0000 (0:00:00.046) 0:03:22.353 ******** skipping: [instance] TASK [manage_secrets : Copy file to location] ********************************** Friday 03 October 2025 13:16:12 +0000 (0:00:00.046) 0:03:22.399 ******** skipping: [instance] TASK [manage_secrets : Create file from content] ******************************* Friday 03 October 2025 13:16:12 +0000 (0:00:00.045) 0:03:22.445 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Debug _secret_dest] ************************************* Friday 03 October 2025 13:16:13 +0000 (0:00:01.003) 0:03:23.449 ******** ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ipmi-things TASK [manage_secrets : Debug _secret_file] ************************************* Friday 03 October 2025 13:16:13 +0000 (0:00:00.048) 0:03:23.498 ******** ok: [instance -> controller-0(controller-0.instance)] => _secret_file: /tmp/ipmi-things TASK [manage_secrets : Debug _secret_content] ********************************** Friday 03 October 2025 13:16:13 +0000 (0:00:00.046) 0:03:23.545 ******** ok: [instance -> controller-0(controller-0.instance)] => _secret_content: '' TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Friday 03 October 2025 13:16:13 +0000 (0:00:00.050) 0:03:23.595 ******** ok: [instance -> controller-0(controller-0.instance)] => changed=false msg: All assertions passed TASK [manage_secrets : Check if pull secret src file exists] ******************* Friday 03 October 2025 13:16:13 +0000 (0:00:00.102) 0:03:23.698 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Copy file to location] ********************************** Friday 03 October 2025 13:16:14 +0000 (0:00:00.554) 0:03:24.252 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Create file from content] ******************************* Friday 03 October 2025 13:16:15 +0000 (0:00:01.011) 0:03:25.263 ******** skipping: [instance] TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** Friday 03 October 2025 13:16:15 +0000 (0:00:00.057) 0:03:25.320 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check if async file is still available] ********************* Friday 03 October 2025 13:16:15 +0000 (0:00:00.554) 0:03:25.875 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check package install status] ******************************* Friday 03 October 2025 13:16:16 +0000 (0:00:00.550) 0:03:26.426 ******** FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (89 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** Friday 03 October 2025 13:17:22 +0000 (0:01:06.737) 0:04:33.163 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Install required packages] ****************************** Friday 03 October 2025 13:17:23 +0000 (0:00:00.682) 0:04:33.846 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get ingresses domain] *********************************** Friday 03 October 2025 13:17:26 +0000 (0:00:02.676) 0:04:36.522 ******** skipping: [instance] TASK [sushy_emulator : Set sushy url for ocp installation] ********************* Friday 03 October 2025 13:17:26 +0000 (0:00:00.048) 0:04:36.571 ******** skipping: [instance] TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** Friday 03 October 2025 13:17:26 +0000 (0:00:00.047) 0:04:36.618 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp private ssh key for later use] ******************** Friday 03 October 2025 13:17:27 +0000 (0:00:00.650) 0:04:37.268 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* Friday 03 October 2025 13:17:27 +0000 (0:00:00.583) 0:04:37.852 ******** changed: [instance] TASK [sushy_emulator : Run ssh-keyscan] **************************************** Friday 03 October 2025 13:17:27 +0000 (0:00:00.314) 0:04:38.167 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write known hosts for later use] ************************ Friday 03 October 2025 13:17:28 +0000 (0:00:00.636) 0:04:38.804 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Friday 03 October 2025 13:17:29 +0000 (0:00:01.047) 0:04:39.851 ******** skipping: [instance] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Friday 03 October 2025 13:17:29 +0000 (0:00:00.047) 0:04:39.898 ******** skipping: [instance] TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Friday 03 October 2025 13:17:29 +0000 (0:00:00.056) 0:04:39.955 ******** skipping: [instance] TASK [sushy_emulator : Generate list of filtered VMs] ************************** Friday 03 October 2025 13:17:29 +0000 (0:00:00.044) 0:04:39.999 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** Friday 03 October 2025 13:17:29 +0000 (0:00:00.057) 0:04:40.057 ******** skipping: [instance] TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** Friday 03 October 2025 13:17:29 +0000 (0:00:00.048) 0:04:40.105 ******** skipping: [instance] TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** Friday 03 October 2025 13:17:29 +0000 (0:00:00.045) 0:04:40.151 ******** skipping: [instance] TASK [sushy_emulator : Generate htpasswd string] ******************************* Friday 03 October 2025 13:17:29 +0000 (0:00:00.044) 0:04:40.196 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write sushy emulator resource loop] ********************* Friday 03 October 2025 13:17:30 +0000 (0:00:00.606) 0:04:40.802 ******** skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=pod) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Write sushy emulator config] **************************** Friday 03 October 2025 13:17:30 +0000 (0:00:00.109) 0:04:40.912 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write htpasswd string to file] ************************** Friday 03 October 2025 13:17:31 +0000 (0:00:01.068) 0:04:41.980 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** Friday 03 October 2025 13:17:32 +0000 (0:00:01.030) 0:04:43.011 ******** skipping: [instance] TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** Friday 03 October 2025 13:17:32 +0000 (0:00:00.045) 0:04:43.056 ******** skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* Friday 03 October 2025 13:17:32 +0000 (0:00:00.048) 0:04:43.105 ******** skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** Friday 03 October 2025 13:17:32 +0000 (0:00:00.084) 0:04:43.189 ******** skipping: [instance] TASK [podman : Ensure podman is installed] ************************************* Friday 03 October 2025 13:17:32 +0000 (0:00:00.046) 0:04:43.236 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [podman : Enable loginctl linger for ansible_user_id] ********************* Friday 03 October 2025 13:17:34 +0000 (0:00:01.525) 0:04:44.762 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* Friday 03 October 2025 13:17:35 +0000 (0:00:00.726) 0:04:45.488 ******** skipping: [instance] TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* Friday 03 October 2025 13:17:35 +0000 (0:00:00.041) 0:04:45.530 ******** skipping: [instance] TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** Friday 03 October 2025 13:17:35 +0000 (0:00:00.038) 0:04:45.569 ******** skipping: [instance] TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** Friday 03 October 2025 13:17:35 +0000 (0:00:00.043) 0:04:45.612 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create and start Sushy Emulator container] ************** Friday 03 October 2025 13:17:45 +0000 (0:00:10.348) 0:04:55.961 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure directories exist] *********************************** Friday 03 October 2025 13:17:46 +0000 (0:00:01.250) 0:04:57.212 ******** ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Convert VBMC list into a dict for better usage] ************* Friday 03 October 2025 13:17:48 +0000 (0:00:01.177) 0:04:58.389 ******** skipping: [instance] TASK [reproducer : Check if baremetal-info.yml exists] ************************* Friday 03 October 2025 13:17:48 +0000 (0:00:00.037) 0:04:58.427 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get content of baremetal-info file] ************************* Friday 03 October 2025 13:17:48 +0000 (0:00:00.563) 0:04:58.990 ******** skipping: [instance] TASK [reproducer : Interpret remote file content as yaml] ********************** Friday 03 October 2025 13:17:48 +0000 (0:00:00.039) 0:04:59.030 ******** skipping: [instance] TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Friday 03 October 2025 13:17:48 +0000 (0:00:00.043) 0:04:59.073 ******** skipping: [instance] TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Friday 03 October 2025 13:17:48 +0000 (0:00:00.041) 0:04:59.115 ******** skipping: [instance] TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** Friday 03 October 2025 13:17:48 +0000 (0:00:00.044) 0:04:59.160 ******** ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '770feada-24a3-4821-8d8a-1a617a5485c7'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': 'd1d20c62-b036-4e77-b90d-2b10b94bca7d'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '768d35e8-0fd6-4061-9668-c65013146649'}) TASK [reproducer : Output baremetal info file] ********************************* Friday 03 October 2025 13:17:49 +0000 (0:00:00.137) 0:04:59.298 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Output ironic_nodes to file] ******************************** Friday 03 October 2025 13:17:50 +0000 (0:00:01.012) 0:05:00.311 ******** skipping: [instance] TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* Friday 03 October 2025 13:17:50 +0000 (0:00:00.051) 0:05:00.363 ******** TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** Friday 03 October 2025 13:17:50 +0000 (0:00:00.139) 0:05:00.502 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Friday 03 October 2025 13:17:50 +0000 (0:00:00.044) 0:05:00.547 ******** skipping: [instance] TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Friday 03 October 2025 13:17:50 +0000 (0:00:00.040) 0:05:00.587 ******** skipping: [instance] TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** Friday 03 October 2025 13:17:50 +0000 (0:00:00.038) 0:05:00.625 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** Friday 03 October 2025 13:17:51 +0000 (0:00:01.349) 0:05:01.975 ******** ok: [instance -> controller-0(controller-0.instance)] => (item=770feada-24a3-4821-8d8a-1a617a5485c7) ok: [instance -> controller-0(controller-0.instance)] => (item=d1d20c62-b036-4e77-b90d-2b10b94bca7d) ok: [instance -> controller-0(controller-0.instance)] => (item=768d35e8-0fd6-4061-9668-c65013146649) TASK [sushy_emulator : Verify baremetal VM power status] *********************** Friday 03 October 2025 13:17:56 +0000 (0:00:04.679) 0:05:06.654 ******** ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** Friday 03 October 2025 13:17:56 +0000 (0:00:00.100) 0:05:06.754 ******** ok: [instance -> localhost] TASK [reproducer : Sync local repositories to other hosts if present] ********** Friday 03 October 2025 13:17:56 +0000 (0:00:00.212) 0:05:06.967 ******** changed: [instance -> localhost] => (item=controller-0) TASK [reproducer : Check if local common-requirements.txt exists] ************** Friday 03 October 2025 13:17:58 +0000 (0:00:01.738) 0:05:08.705 ******** ok: [instance -> localhost] TASK [reproducer : Install ansible dependencies] ******************************* Friday 03 October 2025 13:17:58 +0000 (0:00:00.212) 0:05:08.918 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** Friday 03 October 2025 13:17:59 +0000 (0:00:00.714) 0:05:09.632 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** Friday 03 October 2025 13:18:00 +0000 (0:00:01.058) 0:05:10.691 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject local environment parameters] ************************ Friday 03 October 2025 13:18:01 +0000 (0:00:00.623) 0:05:11.315 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create openshift-environment.yml symlink to old location] *** Friday 03 October 2025 13:18:02 +0000 (0:00:01.027) 0:05:12.342 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get interfaces-info content] ******************************** Friday 03 October 2025 13:18:02 +0000 (0:00:00.623) 0:05:12.965 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Wait for OCP nodes to be ready] ***************************** Friday 03 October 2025 13:18:03 +0000 (0:00:00.602) 0:05:13.568 ******** ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) TASK [networking_mapper : Check for Networking Definition file existence] ****** Friday 03 October 2025 13:18:04 +0000 (0:00:01.348) 0:05:14.916 ******** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Friday 03 October 2025 13:18:04 +0000 (0:00:00.037) 0:05:14.954 ******** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Friday 03 October 2025 13:18:04 +0000 (0:00:00.034) 0:05:14.989 ******** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Friday 03 October 2025 13:18:04 +0000 (0:00:00.035) 0:05:15.024 ******** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Friday 03 October 2025 13:18:04 +0000 (0:00:00.037) 0:05:15.062 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Friday 03 October 2025 13:18:04 +0000 (0:00:00.035) 0:05:15.098 ******** ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) ok: [instance -> controller-0(controller-0.instance)] => (item={}) TASK [networking_mapper : Gather facts if requested] *************************** Friday 03 October 2025 13:18:04 +0000 (0:00:00.101) 0:05:15.199 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance TASK [networking_mapper : Gather the facts] ************************************ Friday 03 October 2025 13:18:05 +0000 (0:00:00.049) 0:05:15.249 ******** ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** Friday 03 October 2025 13:18:08 +0000 (0:00:03.375) 0:05:18.624 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Friday 03 October 2025 13:18:09 +0000 (0:00:01.077) 0:05:19.702 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Definition to file] ************* Friday 03 October 2025 13:18:09 +0000 (0:00:00.507) 0:05:20.210 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Call the networking mapper] ************************** Friday 03 October 2025 13:18:11 +0000 (0:00:01.082) 0:05:21.292 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set networking mapper facts] ************************* Friday 03 October 2025 13:18:11 +0000 (0:00:00.077) 0:05:21.370 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Friday 03 October 2025 13:18:11 +0000 (0:00:00.049) 0:05:21.419 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CRC ssh key] ***************************************** Friday 03 October 2025 13:18:12 +0000 (0:00:00.998) 0:05:22.417 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure we have all dependencies installed] ****************** Friday 03 October 2025 13:18:13 +0000 (0:00:00.980) 0:05:23.398 ******** FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [Configure ntp service] *************************************************** Friday 03 October 2025 13:18:19 +0000 (0:00:05.982) 0:05:29.381 ******** TASK [cifmw_ntp : Install chrony] ********************************************** Friday 03 October 2025 13:18:19 +0000 (0:00:00.257) 0:05:29.638 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Configure original chrony.conf file] ************************* Friday 03 October 2025 13:18:20 +0000 (0:00:00.919) 0:05:30.558 ******** ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) TASK [cifmw_ntp : Render chrony extra config file] ***************************** Friday 03 October 2025 13:18:21 +0000 (0:00:00.926) 0:05:31.484 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Enable chrony service] *************************************** Friday 03 October 2025 13:18:22 +0000 (0:00:00.912) 0:05:32.397 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Configure CRC node if available] **************************** Friday 03 October 2025 13:18:22 +0000 (0:00:00.623) 0:05:33.021 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance TASK [reproducer : Get the networking-environment-definition from controller-0] *** Friday 03 October 2025 13:18:22 +0000 (0:00:00.137) 0:05:33.158 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check which dnsmasq config we must edit] ******************** Friday 03 October 2025 13:18:23 +0000 (0:00:00.441) 0:05:33.600 ******** ok: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Configure local DNS for CRC pod] **************************** Friday 03 October 2025 13:18:23 +0000 (0:00:00.417) 0:05:34.017 ******** changed: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** Friday 03 October 2025 13:18:24 +0000 (0:00:00.634) 0:05:34.651 ******** changed: [instance -> crc-0(crc-0.instance)] TASK [Restart DNS in CRC VM] *************************************************** Friday 03 October 2025 13:18:24 +0000 (0:00:00.553) 0:05:35.205 ******** TASK [openshift_setup : Check which dnsmasq config we must edit] *************** Friday 03 October 2025 13:18:25 +0000 (0:00:00.049) 0:05:35.254 ******** ok: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Restart dnsmasq service if used] *********************** Friday 03 October 2025 13:18:25 +0000 (0:00:00.470) 0:05:35.725 ******** changed: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Stop dnsmasq] ****************************************** Friday 03 October 2025 13:18:26 +0000 (0:00:00.688) 0:05:36.413 ******** skipping: [instance] TASK [openshift_setup : Start dnsmasq] ***************************************** Friday 03 October 2025 13:18:26 +0000 (0:00:00.027) 0:05:36.441 ******** skipping: [instance] TASK [reproducer : Remove entry from /etc/hosts] ******************************* Friday 03 October 2025 13:18:26 +0000 (0:00:00.034) 0:05:36.476 ******** changed: [instance] TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** Friday 03 October 2025 13:18:26 +0000 (0:00:00.221) 0:05:36.697 ******** skipping: [instance] => (item=) TASK [dnsmasq : Assert we have needed address data] **************************** Friday 03 October 2025 13:18:26 +0000 (0:00:00.069) 0:05:36.766 ******** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Friday 03 October 2025 13:18:26 +0000 (0:00:00.029) 0:05:36.796 ******** ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Friday 03 October 2025 13:18:26 +0000 (0:00:00.069) 0:05:36.866 ******** changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ Friday 03 October 2025 13:18:26 +0000 (0:00:00.244) 0:05:37.110 ******** TASK [dnsmasq : Assert we have needed host record data] ************************ Friday 03 October 2025 13:18:26 +0000 (0:00:00.045) 0:05:37.156 ******** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Friday 03 October 2025 13:18:26 +0000 (0:00:00.059) 0:05:37.215 ******** ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Friday 03 October 2025 13:18:27 +0000 (0:00:00.057) 0:05:37.272 ******** changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [reproducer : Ensure "testing" domain is "local"] ************************* Friday 03 October 2025 13:18:27 +0000 (0:00:00.258) 0:05:37.530 ******** changed: [instance] TASK [reproducer : Flush handlers] ********************************************* Friday 03 October 2025 13:18:27 +0000 (0:00:00.400) 0:05:37.931 ******** RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** Friday 03 October 2025 13:18:27 +0000 (0:00:00.014) 0:05:37.945 ******** changed: [instance -> controller-0(controller-0.instance)] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Friday 03 October 2025 13:18:28 +0000 (0:00:00.686) 0:05:38.632 ******** changed: [instance] TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** Friday 03 October 2025 13:18:28 +0000 (0:00:00.381) 0:05:39.013 ******** skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** Friday 03 October 2025 13:18:28 +0000 (0:00:00.175) 0:05:39.188 ******** changed: [instance -> compute-0(compute-0.instance)] TASK [reproducer : Tweak dnf configuration] ************************************ Friday 03 October 2025 13:18:30 +0000 (0:00:01.448) 0:05:40.637 ******** skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Friday 03 October 2025 13:18:30 +0000 (0:00:00.018) 0:05:40.655 ******** ok: [instance -> compute-0(compute-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Friday 03 October 2025 13:18:30 +0000 (0:00:00.478) 0:05:41.133 ******** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Friday 03 October 2025 13:18:30 +0000 (0:00:00.033) 0:05:41.166 ******** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Friday 03 October 2025 13:18:30 +0000 (0:00:00.035) 0:05:41.202 ******** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Friday 03 October 2025 13:18:30 +0000 (0:00:00.035) 0:05:41.238 ******** changed: [instance -> compute-0(compute-0.instance)] TASK [reproducer : Get rhos-release and setup repos] *************************** Friday 03 October 2025 13:18:32 +0000 (0:00:01.443) 0:05:42.681 ******** skipping: [instance] TASK [reproducer : Create repositories on computes] **************************** Friday 03 October 2025 13:18:32 +0000 (0:00:00.035) 0:05:42.716 ******** skipping: [instance] TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* Friday 03 October 2025 13:18:32 +0000 (0:00:00.071) 0:05:42.788 ******** skipping: [instance] TASK [reproducer : Push local code] ******************************************** Friday 03 October 2025 13:18:32 +0000 (0:00:00.030) 0:05:42.818 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance TASK [reproducer : Check if repository directories already exist] ************** Friday 03 October 2025 13:18:32 +0000 (0:00:00.095) 0:05:42.914 ******** skipping: [instance] TASK [reproducer : Ensure we are not in the job_id branch] ********************* Friday 03 October 2025 13:18:32 +0000 (0:00:00.039) 0:05:42.954 ******** skipping: [instance] TASK [reproducer : Fetch zuul.items repositories] ****************************** Friday 03 October 2025 13:18:32 +0000 (0:00:00.041) 0:05:42.995 ******** skipping: [instance] TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** Friday 03 October 2025 13:18:32 +0000 (0:00:00.040) 0:05:43.036 ******** skipping: [instance] TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** Friday 03 October 2025 13:18:32 +0000 (0:00:00.043) 0:05:43.080 ******** skipping: [instance] TASK [reproducer : Create target directories beforehand] *********************** Friday 03 October 2025 13:18:32 +0000 (0:00:00.038) 0:05:43.118 ******** ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) TASK [reproducer : Sync local repositories to ansible controller] ************** Friday 03 October 2025 13:18:33 +0000 (0:00:00.488) 0:05:43.607 ******** ok: [instance -> localhost] => (item=ci-framework) TASK [reproducer : Sync remote repositories] *********************************** Friday 03 October 2025 13:18:33 +0000 (0:00:00.567) 0:05:44.175 ******** skipping: [instance] => (item=ci-framework) skipping: [instance] TASK [reproducer : Ensure default repositories are present] ******************** Friday 03 October 2025 13:18:33 +0000 (0:00:00.040) 0:05:44.215 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) TASK [reproducer : Check repository availability: ci-framework] **************** Friday 03 October 2025 13:18:34 +0000 (0:00:00.058) 0:05:44.274 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: ci-framework] ******************* Friday 03 October 2025 13:18:34 +0000 (0:00:00.462) 0:05:44.737 ******** skipping: [instance] TASK [reproducer : Check repository availability: install_yamls] *************** Friday 03 October 2025 13:18:34 +0000 (0:00:00.039) 0:05:44.776 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: install_yamls] ****************** Friday 03 October 2025 13:18:34 +0000 (0:00:00.470) 0:05:45.246 ******** skipping: [instance] TASK [reproducer : Check repository availability: architecture] **************** Friday 03 October 2025 13:18:35 +0000 (0:00:00.037) 0:05:45.284 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: architecture] ******************* Friday 03 October 2025 13:18:35 +0000 (0:00:00.445) 0:05:45.729 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install collections on controller-0] ************************ Friday 03 October 2025 13:18:37 +0000 (0:00:02.191) 0:05:47.920 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CI Framework motd] *********************************** Friday 03 October 2025 13:18:56 +0000 (0:00:19.138) 0:06:07.059 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate some logs] ******************************************* Friday 03 October 2025 13:18:57 +0000 (0:00:00.990) 0:06:08.049 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* Friday 03 October 2025 13:18:57 +0000 (0:00:00.095) 0:06:08.144 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate log if present] ************************************** Friday 03 October 2025 13:18:58 +0000 (0:00:00.494) 0:06:08.639 ******** skipping: [instance] TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** Friday 03 October 2025 13:18:58 +0000 (0:00:00.036) 0:06:08.675 ******** skipping: [instance] TASK [cifmw_setup : Get customized parameters] ********************************* Friday 03 October 2025 13:18:58 +0000 (0:00:00.038) 0:06:08.714 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Ensure target directory exists] ***************************** Friday 03 October 2025 13:18:58 +0000 (0:00:00.090) 0:06:08.804 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Friday 03 October 2025 13:18:59 +0000 (0:00:00.497) 0:06:09.302 ******** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Friday 03 October 2025 13:18:59 +0000 (0:00:00.037) 0:06:09.340 ******** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Friday 03 October 2025 13:18:59 +0000 (0:00:00.037) 0:06:09.377 ******** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Friday 03 October 2025 13:18:59 +0000 (0:00:00.037) 0:06:09.415 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Ensure directories are present] ***************************** Friday 03 October 2025 13:19:00 +0000 (0:00:01.406) 0:06:10.822 ******** changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [repo_setup : Make sure git-core package is installed] ******************** Friday 03 October 2025 13:19:01 +0000 (0:00:01.334) 0:06:12.157 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Get repo-setup repository] ********************************** Friday 03 October 2025 13:19:02 +0000 (0:00:00.936) 0:06:13.093 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Initialize python venv and install requirements] ************ Friday 03 October 2025 13:19:04 +0000 (0:00:01.308) 0:06:14.401 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Install repo-setup package] ********************************* Friday 03 October 2025 13:19:12 +0000 (0:00:08.079) 0:06:22.481 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Friday 03 October 2025 13:19:13 +0000 (0:00:00.957) 0:06:23.439 ******** skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Friday 03 October 2025 13:19:13 +0000 (0:00:00.041) 0:06:23.480 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Get component repo] ***************************************** Friday 03 October 2025 13:19:14 +0000 (0:00:01.170) 0:06:24.651 ******** skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Friday 03 October 2025 13:19:14 +0000 (0:00:00.046) 0:06:24.698 ******** skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Friday 03 October 2025 13:19:14 +0000 (0:00:00.045) 0:06:24.744 ******** skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Friday 03 October 2025 13:19:14 +0000 (0:00:00.044) 0:06:24.788 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Friday 03 October 2025 13:19:15 +0000 (0:00:00.845) 0:06:25.634 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Dump current-podified hash] ********************************* Friday 03 October 2025 13:19:16 +0000 (0:00:00.867) 0:06:26.501 ******** skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Friday 03 October 2025 13:19:16 +0000 (0:00:00.041) 0:06:26.543 ******** skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Friday 03 October 2025 13:19:16 +0000 (0:00:00.040) 0:06:26.583 ******** skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Friday 03 October 2025 13:19:16 +0000 (0:00:00.042) 0:06:26.626 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Create download directory] ********************************** Friday 03 October 2025 13:19:16 +0000 (0:00:00.051) 0:06:26.677 ******** skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Friday 03 October 2025 13:19:16 +0000 (0:00:00.039) 0:06:26.716 ******** skipping: [instance] TASK [Download the RPM] ******************************************************** Friday 03 October 2025 13:19:16 +0000 (0:00:00.039) 0:06:26.755 ******** skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Friday 03 October 2025 13:19:16 +0000 (0:00:00.044) 0:06:26.800 ******** skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Friday 03 October 2025 13:19:16 +0000 (0:00:00.041) 0:06:26.841 ******** skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Friday 03 October 2025 13:19:16 +0000 (0:00:00.038) 0:06:26.880 ******** skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Friday 03 October 2025 13:19:16 +0000 (0:00:00.039) 0:06:26.920 ******** skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Friday 03 October 2025 13:19:16 +0000 (0:00:00.042) 0:06:26.962 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Friday 03 October 2025 13:19:17 +0000 (0:00:00.478) 0:06:27.440 ******** skipping: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Friday 03 October 2025 13:19:17 +0000 (0:00:00.046) 0:06:27.487 ******** skipping: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Friday 03 October 2025 13:19:17 +0000 (0:00:00.042) 0:06:27.530 ******** skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Friday 03 October 2025 13:19:17 +0000 (0:00:00.044) 0:06:27.574 ******** skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Friday 03 October 2025 13:19:17 +0000 (0:00:00.046) 0:06:27.621 ******** skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Friday 03 October 2025 13:19:17 +0000 (0:00:00.102) 0:06:27.723 ******** skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Friday 03 October 2025 13:19:17 +0000 (0:00:00.040) 0:06:27.764 ******** skipping: [instance] TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** Friday 03 October 2025 13:19:17 +0000 (0:00:00.044) 0:06:27.808 ******** skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Friday 03 October 2025 13:19:17 +0000 (0:00:00.041) 0:06:27.849 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Friday 03 October 2025 13:19:18 +0000 (0:00:00.549) 0:06:28.398 ******** changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [repo_setup : Cleanup existing metadata] ********************************** Friday 03 October 2025 13:19:19 +0000 (0:00:00.917) 0:06:29.316 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Friday 03 October 2025 13:19:19 +0000 (0:00:00.682) 0:06:29.998 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Gather variables for each operating system] ******************* Friday 03 October 2025 13:19:20 +0000 (0:00:00.504) 0:06:30.503 ******** ok: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0] TASK [ci_setup : List packages to install] ************************************* Friday 03 October 2025 13:19:20 +0000 (0:00:00.059) 0:06:30.563 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Install needed packages] ************************************** Friday 03 October 2025 13:19:20 +0000 (0:00:00.043) 0:06:30.606 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Gather version of openshift client] *************************** Friday 03 October 2025 13:19:52 +0000 (0:00:32.014) 0:07:02.620 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Ensure openshift client install path is present] ************** Friday 03 October 2025 13:19:52 +0000 (0:00:00.475) 0:07:03.096 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Install openshift client] ************************************* Friday 03 October 2025 13:19:53 +0000 (0:00:00.484) 0:07:03.580 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** Friday 03 October 2025 13:19:59 +0000 (0:00:05.668) 0:07:09.248 ******** skipping: [instance] TASK [ci_setup : Create completion file] *************************************** Friday 03 October 2025 13:19:59 +0000 (0:00:00.041) 0:07:09.290 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Source completion from within .bashrc] ************************ Friday 03 October 2025 13:19:59 +0000 (0:00:00.540) 0:07:09.831 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Check rhsm status] ******************************************** Friday 03 October 2025 13:20:00 +0000 (0:00:00.455) 0:07:10.286 ******** skipping: [instance] TASK [ci_setup : Gather the repos to be enabled] ******************************* Friday 03 October 2025 13:20:00 +0000 (0:00:00.038) 0:07:10.325 ******** skipping: [instance] TASK [ci_setup : Enabling the required repositories.] ************************** Friday 03 October 2025 13:20:00 +0000 (0:00:00.042) 0:07:10.368 ******** skipping: [instance] TASK [ci_setup : Get current /etc/redhat-release] ****************************** Friday 03 October 2025 13:20:00 +0000 (0:00:00.036) 0:07:10.405 ******** skipping: [instance] TASK [ci_setup : Print current /etc/redhat-release] **************************** Friday 03 October 2025 13:20:00 +0000 (0:00:00.035) 0:07:10.440 ******** skipping: [instance] TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* Friday 03 October 2025 13:20:00 +0000 (0:00:00.036) 0:07:10.477 ******** skipping: [instance] TASK [ci_setup : Manage directories] ******************************************* Friday 03 October 2025 13:20:00 +0000 (0:00:00.040) 0:07:10.517 ******** changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [Prepare install_yamls make targets] ************************************** Friday 03 October 2025 13:20:02 +0000 (0:00:02.321) 0:07:12.839 ******** TASK [install_yamls : Ensure directories exist] ******************************** Friday 03 October 2025 13:20:02 +0000 (0:00:00.158) 0:07:12.997 ******** ok: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [Create variables with local repos based on Zuul items] ******************* Friday 03 October 2025 13:20:04 +0000 (0:00:01.325) 0:07:14.323 ******** TASK [install_yamls : Set fact with local repos based on Zuul items] *********** Friday 03 October 2025 13:20:04 +0000 (0:00:00.065) 0:07:14.389 ******** skipping: [instance] TASK [install_yamls : Print helpful data for debugging] ************************ Friday 03 October 2025 13:20:04 +0000 (0:00:00.043) 0:07:14.432 ******** skipping: [instance] TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** Friday 03 October 2025 13:20:04 +0000 (0:00:00.050) 0:07:14.483 ******** ok: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0] TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** Friday 03 October 2025 13:20:04 +0000 (0:00:00.092) 0:07:14.575 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Get environment structure] ******************************* Friday 03 October 2025 13:20:04 +0000 (0:00:00.053) 0:07:14.629 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Ensure Output directory exists] ************************** Friday 03 October 2025 13:20:05 +0000 (0:00:00.929) 0:07:15.558 ******** skipping: [instance] TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** Friday 03 October 2025 13:20:05 +0000 (0:00:00.037) 0:07:15.595 ******** skipping: [instance] TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** Friday 03 October 2025 13:20:05 +0000 (0:00:00.044) 0:07:15.640 ******** skipping: [instance] TASK [install_yamls : Set install_yamls default values] ************************ Friday 03 October 2025 13:20:05 +0000 (0:00:00.037) 0:07:15.678 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Show the env structure] ********************************** Friday 03 October 2025 13:20:05 +0000 (0:00:00.053) 0:07:15.732 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Show the env structure defaults] ************************* Friday 03 October 2025 13:20:05 +0000 (0:00:00.045) 0:07:15.777 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Generate make targets] *********************************** Friday 03 October 2025 13:20:05 +0000 (0:00:00.055) 0:07:15.833 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Debug generate_make module] ****************************** Friday 03 October 2025 13:20:06 +0000 (0:00:00.587) 0:07:16.421 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Create the install_yamls parameters file] **************** Friday 03 October 2025 13:20:06 +0000 (0:00:00.045) 0:07:16.467 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** Friday 03 October 2025 13:20:07 +0000 (0:00:00.877) 0:07:17.345 ******** skipping: [instance] TASK [discover_latest_image : Get latest image] ******************************** Friday 03 October 2025 13:20:07 +0000 (0:00:00.045) 0:07:17.390 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [discover_latest_image : Export facts accordingly] ************************ Friday 03 October 2025 13:20:07 +0000 (0:00:00.665) 0:07:18.056 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [cifmw_setup : Create artifacts with custom params] *********************** Friday 03 October 2025 13:20:07 +0000 (0:00:00.053) 0:07:18.110 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* Friday 03 October 2025 13:20:08 +0000 (0:00:00.879) 0:07:18.989 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [Configure CRC network if needed] ***************************************** Friday 03 October 2025 13:20:09 +0000 (0:00:00.469) 0:07:19.458 ******** TASK [openshift_setup : Gather network.operator info] ************************** Friday 03 October 2025 13:20:09 +0000 (0:00:00.150) 0:07:19.609 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [openshift_setup : Patch network operator] ******************************** Friday 03 October 2025 13:20:10 +0000 (0:00:01.131) 0:07:20.740 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [Ensure OCP cluster is stable] ******************************************** Friday 03 October 2025 13:20:11 +0000 (0:00:01.121) 0:07:21.861 ******** skipping: [instance] TASK [reproducer : Emulate CI job] ********************************************* Friday 03 October 2025 13:20:11 +0000 (0:00:00.026) 0:07:21.888 ******** skipping: [instance] TASK [reproducer : Prepare architecture-based deployment] ********************** Friday 03 October 2025 13:20:11 +0000 (0:00:00.035) 0:07:21.924 ******** skipping: [instance] TASK [reproducer : Prepare architecture-based post deployment] ***************** Friday 03 October 2025 13:20:11 +0000 (0:00:00.035) 0:07:21.960 ******** skipping: [instance] TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** Friday 03 October 2025 13:20:11 +0000 (0:00:00.038) 0:07:21.998 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** Friday 03 October 2025 13:20:12 +0000 (0:00:00.920) 0:07:22.919 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [Ensure we have needed inventory files] *********************************** Friday 03 October 2025 13:20:13 +0000 (0:00:00.477) 0:07:23.396 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [Ensure we have CRC ssh key] ********************************************** Friday 03 October 2025 13:20:13 +0000 (0:00:00.457) 0:07:23.853 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [Ensure we have the MAC mapping file] ************************************* Friday 03 October 2025 13:20:14 +0000 (0:00:00.490) 0:07:24.344 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [Load crc inventory] ****************************************************** Friday 03 October 2025 13:20:14 +0000 (0:00:00.448) 0:07:24.792 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [Load compute inventory] ************************************************** Friday 03 October 2025 13:20:14 +0000 (0:00:00.435) 0:07:25.228 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** Friday 03 October 2025 13:20:15 +0000 (0:00:00.446) 0:07:25.674 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* Friday 03 October 2025 13:20:15 +0000 (0:00:00.454) 0:07:26.129 ******** changed: [instance -> controller-0(controller-0.instance)] TASK [Check default location secret file] ************************************** Friday 03 October 2025 13:20:16 +0000 (0:00:00.478) 0:07:26.608 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [Check non-default location secret] *************************************** Friday 03 October 2025 13:20:16 +0000 (0:00:00.475) 0:07:27.084 ******** ok: [instance -> controller-0(controller-0.instance)] TASK [Assert all of the tests] ************************************************* Friday 03 October 2025 13:20:17 +0000 (0:00:00.465) 0:07:27.549 ******** ok: [instance] TASK [Create dnsmasq dir] ****************************************************** Friday 03 October 2025 13:20:17 +0000 (0:00:00.038) 0:07:27.588 ******** changed: [instance] TASK [Get journalctl in a file] ************************************************ Friday 03 October 2025 13:20:17 +0000 (0:00:00.201) 0:07:27.789 ******** changed: [instance] TASK [Dump journalctl output] ************************************************** Friday 03 October 2025 13:20:17 +0000 (0:00:00.218) 0:07:28.008 ******** changed: [instance] TASK [Copy all dnsmasq config] ************************************************* Friday 03 October 2025 13:20:18 +0000 (0:00:00.383) 0:07:28.392 ******** changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) TASK [Create log directory] **************************************************** Friday 03 October 2025 13:20:18 +0000 (0:00:00.514) 0:07:28.907 ******** changed: [instance] TASK [Sync logs from controller-0] ********************************************* Friday 03 October 2025 13:20:18 +0000 (0:00:00.213) 0:07:29.120 ******** changed: [instance] PLAY RECAP ********************************************************************* instance : ok=540 changed=203 unreachable=0 failed=0 skipped=216 rescued=0 ignored=0 Friday 03 October 2025 13:20:19 +0000 (0:00:00.912) 0:07:30.033 ******** =============================================================================== reproducer : Check package install status ------------------------------ 66.74s libvirt_manager : Download base image ---------------------------------- 37.80s ci_setup : Install needed packages ------------------------------------- 32.01s libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.74s reproducer : Install collections on controller-0 ----------------------- 19.14s sushy_emulator : Pull Sushy Emulator container image ------------------- 10.35s libvirt_manager : Install packages required for using KVM --------------- 8.42s repo_setup : Initialize python venv and install requirements ------------ 8.08s reproducer : Ensure we have all dependencies installed ------------------ 5.98s ci_setup : Install openshift client ------------------------------------- 5.67s ci_nmstate : Install required packages on localhost --------------------- 5.64s sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 4.68s dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.91s networking_mapper : Gather the facts ------------------------------------ 3.38s dnsmasq : Add/Remove address -------------------------------------------- 3.34s sushy_emulator : Install required packages ------------------------------ 2.68s ci_setup : Manage directories ------------------------------------------- 2.32s reproducer : Clone repository if needed: architecture ------------------- 2.19s dnsmasq : Add DHCP entries ---------------------------------------------- 2.10s libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s PLAY [Prepare] ***************************************************************** TASK [Call task file in loop] ************************************************** Friday 03 October 2025 13:20:20 +0000 (0:00:00.033) 0:00:00.033 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** Friday 03 October 2025 13:20:20 +0000 (0:00:00.067) 0:00:00.101 ******** TASK [reproducer : Apply regex match filter] *********************************** Friday 03 October 2025 13:20:20 +0000 (0:00:00.038) 0:00:00.139 ******** ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Friday 03 October 2025 13:20:20 +0000 (0:00:00.033) 0:00:00.173 ******** ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Friday 03 October 2025 13:20:20 +0000 (0:00:00.036) 0:00:00.210 ******** ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Friday 03 October 2025 13:20:20 +0000 (0:00:00.049) 0:00:00.259 ******** skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Friday 03 October 2025 13:20:20 +0000 (0:00:00.026) 0:00:00.286 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** Friday 03 October 2025 13:20:20 +0000 (0:00:00.051) 0:00:00.337 ******** TASK [reproducer : Apply regex match filter] *********************************** Friday 03 October 2025 13:20:20 +0000 (0:00:00.035) 0:00:00.373 ******** ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Friday 03 October 2025 13:20:20 +0000 (0:00:00.033) 0:00:00.407 ******** ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Friday 03 October 2025 13:20:20 +0000 (0:00:00.039) 0:00:00.447 ******** ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Friday 03 October 2025 13:20:20 +0000 (0:00:00.037) 0:00:00.484 ******** skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Friday 03 October 2025 13:20:20 +0000 (0:00:00.026) 0:00:00.511 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** Friday 03 October 2025 13:20:20 +0000 (0:00:00.034) 0:00:00.545 ******** TASK [reproducer : Apply regex match filter] *********************************** Friday 03 October 2025 13:20:20 +0000 (0:00:00.036) 0:00:00.581 ******** ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Friday 03 October 2025 13:20:20 +0000 (0:00:00.034) 0:00:00.615 ******** ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Friday 03 October 2025 13:20:21 +0000 (0:00:00.037) 0:00:00.653 ******** ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.037) 0:00:00.691 ******** skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.024) 0:00:00.716 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** Friday 03 October 2025 13:20:21 +0000 (0:00:00.035) 0:00:00.751 ******** TASK [reproducer : Apply regex match filter] *********************************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.036) 0:00:00.788 ******** ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.035) 0:00:00.823 ******** ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Friday 03 October 2025 13:20:21 +0000 (0:00:00.038) 0:00:00.861 ******** ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.036) 0:00:00.898 ******** skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.029) 0:00:00.927 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** Friday 03 October 2025 13:20:21 +0000 (0:00:00.035) 0:00:00.963 ******** TASK [reproducer : Apply regex match filter] *********************************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.060) 0:00:01.023 ******** ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.035) 0:00:01.059 ******** fatal: [instance]: FAILED! => changed=false assertion: _matched_url | default('') | length > 0 evaluated_to: false msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' TASK [Clear errors to manually handle them] ************************************ Friday 03 October 2025 13:20:21 +0000 (0:00:00.039) 0:00:01.098 ******** TASK [Really fail if string passed but should have failed] ********************* Friday 03 October 2025 13:20:21 +0000 (0:00:00.016) 0:00:01.114 ******** skipping: [instance] TASK [Really fail if string failed but should have passed] ********************* Friday 03 October 2025 13:20:21 +0000 (0:00:00.033) 0:00:01.148 ******** skipping: [instance] TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** Friday 03 October 2025 13:20:21 +0000 (0:00:00.032) 0:00:01.181 ******** TASK [reproducer : Apply regex match filter] *********************************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.036) 0:00:01.217 ******** ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.033) 0:00:01.251 ******** fatal: [instance]: FAILED! => changed=false assertion: _matched_url | default('') | length > 0 evaluated_to: false msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' TASK [Clear errors to manually handle them] ************************************ Friday 03 October 2025 13:20:21 +0000 (0:00:00.042) 0:00:01.294 ******** TASK [Really fail if string passed but should have failed] ********************* Friday 03 October 2025 13:20:21 +0000 (0:00:00.016) 0:00:01.310 ******** skipping: [instance] TASK [Really fail if string failed but should have passed] ********************* Friday 03 October 2025 13:20:21 +0000 (0:00:00.034) 0:00:01.345 ******** skipping: [instance] TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** Friday 03 October 2025 13:20:21 +0000 (0:00:00.033) 0:00:01.378 ******** TASK [reproducer : Apply regex match filter] *********************************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.036) 0:00:01.415 ******** ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.034) 0:00:01.450 ******** ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Friday 03 October 2025 13:20:21 +0000 (0:00:00.037) 0:00:01.487 ******** ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.038) 0:00:01.525 ******** skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Friday 03 October 2025 13:20:21 +0000 (0:00:00.026) 0:00:01.551 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** Friday 03 October 2025 13:20:21 +0000 (0:00:00.036) 0:00:01.588 ******** TASK [reproducer : Apply regex match filter] *********************************** Friday 03 October 2025 13:20:22 +0000 (0:00:00.064) 0:00:01.652 ******** ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Friday 03 October 2025 13:20:22 +0000 (0:00:00.034) 0:00:01.687 ******** ok: [instance] TASK [reproducer : Extract job id for later reference] ************************* Friday 03 October 2025 13:20:22 +0000 (0:00:00.039) 0:00:01.727 ******** ok: [instance] TASK [Fail if return string doesn't match expected value] ********************** Friday 03 October 2025 13:20:22 +0000 (0:00:00.044) 0:00:01.771 ******** skipping: [instance] TASK [Fail if string incorrectly passed when defined not to pass] ************** Friday 03 October 2025 13:20:22 +0000 (0:00:00.027) 0:00:01.798 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** Friday 03 October 2025 13:20:22 +0000 (0:00:00.037) 0:00:01.835 ******** TASK [reproducer : Apply regex match filter] *********************************** Friday 03 October 2025 13:20:22 +0000 (0:00:00.041) 0:00:01.877 ******** ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Friday 03 October 2025 13:20:22 +0000 (0:00:00.035) 0:00:01.913 ******** fatal: [instance]: FAILED! => changed=false assertion: _matched_url | default('') | length > 0 evaluated_to: false msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' TASK [Clear errors to manually handle them] ************************************ Friday 03 October 2025 13:20:22 +0000 (0:00:00.043) 0:00:01.957 ******** TASK [Really fail if string passed but should have failed] ********************* Friday 03 October 2025 13:20:22 +0000 (0:00:00.018) 0:00:01.975 ******** skipping: [instance] TASK [Really fail if string failed but should have passed] ********************* Friday 03 October 2025 13:20:22 +0000 (0:00:00.037) 0:00:02.012 ******** skipping: [instance] TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** Friday 03 October 2025 13:20:22 +0000 (0:00:00.037) 0:00:02.050 ******** TASK [reproducer : Apply regex match filter] *********************************** Friday 03 October 2025 13:20:22 +0000 (0:00:00.039) 0:00:02.090 ******** ok: [instance] TASK [reproducer : Verify URL is valid] **************************************** Friday 03 October 2025 13:20:22 +0000 (0:00:00.035) 0:00:02.125 ******** fatal: [instance]: FAILED! => changed=false assertion: _matched_url | default('') | length > 0 evaluated_to: false msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' TASK [Clear errors to manually handle them] ************************************ Friday 03 October 2025 13:20:22 +0000 (0:00:00.039) 0:00:02.165 ******** TASK [Really fail if string passed but should have failed] ********************* Friday 03 October 2025 13:20:22 +0000 (0:00:00.016) 0:00:02.182 ******** skipping: [instance] TASK [Really fail if string failed but should have passed] ********************* Friday 03 October 2025 13:20:22 +0000 (0:00:00.034) 0:00:02.217 ******** skipping: [instance] TASK [Print success message] *************************************************** Friday 03 October 2025 13:20:22 +0000 (0:00:00.034) 0:00:02.251 ******** ok: [instance] => msg: All strings passed! PLAY RECAP ********************************************************************* instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 Friday 03 October 2025 13:20:22 +0000 (0:00:00.074) 0:00:02.326 ******** =============================================================================== Print success message --------------------------------------------------- 0.07s Call task file in loop -------------------------------------------------- 0.07s Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.06s Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.06s Fail if string incorrectly passed when defined not to pass -------------- 0.05s reproducer : Extract job id for later reference ------------------------- 0.05s reproducer : Extract job id for later reference ------------------------- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 --- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a --- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s reproducer : Extract job id for later reference ------------------------- 0.04s Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything///// --- 0.04s reproducer : Extract job id for later reference ------------------------- 0.04s reproducer : Verify URL is valid ---------------------------------------- 0.04s PLAY [Prepare] ***************************************************************** TASK [Set failed fact] ********************************************************* Friday 03 October 2025 13:20:23 +0000 (0:00:00.033) 0:00:00.033 ******** ok: [instance] TASK [Load scenarios] ********************************************************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.021) 0:00:00.054 ******** ok: [instance] TASK [Test network validations] ************************************************ Friday 03 October 2025 13:20:23 +0000 (0:00:00.023) 0:00:00.077 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.058) 0:00:00.136 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.020) 0:00:00.157 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.025) 0:00:00.182 ******** ok: [instance] => msg: 'Running: Default nets only' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.024) 0:00:00.206 ******** TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Friday 03 October 2025 13:20:23 +0000 (0:00:00.042) 0:00:00.249 ******** [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. ok: [instance] => (item=controller) TASK [reproducer : Ensure all standard attached networks are defined] ********** Friday 03 October 2025 13:20:23 +0000 (0:00:00.063) 0:00:00.312 ******** ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.054) 0:00:00.366 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:23 +0000 (0:00:00.063) 0:00:00.430 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.036) 0:00:00.466 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.031) 0:00:00.498 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.031) 0:00:00.529 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.021) 0:00:00.551 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.026) 0:00:00.578 ******** ok: [instance] => msg: 'Running: Default nets and spine/leaf' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.028) 0:00:00.607 ******** TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Friday 03 October 2025 13:20:23 +0000 (0:00:00.039) 0:00:00.646 ******** [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. ok: [instance] => (item=controller) TASK [reproducer : Ensure all standard attached networks are defined] ********** Friday 03 October 2025 13:20:23 +0000 (0:00:00.043) 0:00:00.690 ******** ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Friday 03 October 2025 13:20:23 +0000 (0:00:00.059) 0:00:00.750 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:24 +0000 (0:00:00.063) 0:00:00.814 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.037) 0:00:00.851 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.034) 0:00:00.885 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.039) 0:00:00.925 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.021) 0:00:00.946 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.028) 0:00:00.974 ******** ok: [instance] => msg: 'Running: Default nets with extra defined net' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.023) 0:00:00.998 ******** TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Friday 03 October 2025 13:20:24 +0000 (0:00:00.039) 0:00:01.037 ******** [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. ok: [instance] => (item=controller) TASK [reproducer : Ensure all standard attached networks are defined] ********** Friday 03 October 2025 13:20:24 +0000 (0:00:00.045) 0:00:01.082 ******** ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.075) 0:00:01.158 ******** fatal: [instance]: FAILED! => changed=false assertion: _defined | difference(_all_nets) | length == 0 evaluated_to: false msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' TASK [reproducer : Dump initial layout] **************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.060) 0:00:01.219 ******** ok: [instance] => cifmw_libvirt_manager_configuration: networks: public: defined vms: controller: nets: - public TASK [reproducer : Dump CI reproducer generated layout] ************************ Friday 03 October 2025 13:20:24 +0000 (0:00:00.030) 0:00:01.250 ******** skipping: [instance] TASK [reproducer : Dump layout patches] **************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.026) 0:00:01.277 ******** skipping: [instance] TASK [reproducer : Dump built layout] ****************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.065) 0:00:01.342 ******** ok: [instance] => _cifmw_libvirt_manager_layout: networks: extra_net_1: defined public: defined vms: controller: nets: - public TASK [reproducer : Fail for good] ********************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.037) 0:00:01.380 ******** fatal: [instance]: FAILED! => changed=false msg: Error detected, please check assertions and debugging output above. TASK [Clear host errors] ******************************************************* Friday 03 October 2025 13:20:24 +0000 (0:00:00.022) 0:00:01.402 ******** TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.015) 0:00:01.418 ******** ok: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:24 +0000 (0:00:00.021) 0:00:01.440 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.034) 0:00:01.475 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.032) 0:00:01.508 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.031) 0:00:01.540 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.021) 0:00:01.561 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.024) 0:00:01.585 ******** ok: [instance] => msg: 'Running: Missing default net definition' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.025) 0:00:01.611 ******** TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Friday 03 October 2025 13:20:24 +0000 (0:00:00.039) 0:00:01.651 ******** [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. ok: [instance] => (item=controller) TASK [reproducer : Ensure all standard attached networks are defined] ********** Friday 03 October 2025 13:20:24 +0000 (0:00:00.043) 0:00:01.694 ******** fatal: [instance]: FAILED! => changed=false assertion: _all_nets | difference(_defined) | length == 0 evaluated_to: false msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' TASK [reproducer : Dump initial layout] **************************************** Friday 03 October 2025 13:20:24 +0000 (0:00:00.054) 0:00:01.748 ******** ok: [instance] => cifmw_libvirt_manager_configuration: networks: public: defined vms: controller: nets: - public TASK [reproducer : Dump CI reproducer generated layout] ************************ Friday 03 October 2025 13:20:24 +0000 (0:00:00.031) 0:00:01.780 ******** skipping: [instance] TASK [reproducer : Dump layout patches] **************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.026) 0:00:01.807 ******** skipping: [instance] TASK [reproducer : Dump built layout] ****************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.088) 0:00:01.895 ******** ok: [instance] => _cifmw_libvirt_manager_layout: networks: public: defined vms: controller: nets: - public - foo TASK [reproducer : Fail for good] ********************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.038) 0:00:01.934 ******** fatal: [instance]: FAILED! => changed=false msg: Error detected, please check assertions and debugging output above. TASK [Clear host errors] ******************************************************* Friday 03 October 2025 13:20:25 +0000 (0:00:00.043) 0:00:01.978 ******** TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.015) 0:00:01.993 ******** ok: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:25 +0000 (0:00:00.023) 0:00:02.017 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.036) 0:00:02.053 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.034) 0:00:02.088 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.031) 0:00:02.119 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.022) 0:00:02.142 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.025) 0:00:02.167 ******** ok: [instance] => msg: 'Running: Missing spine/leaf net definition' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.025) 0:00:02.193 ******** TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Friday 03 October 2025 13:20:25 +0000 (0:00:00.045) 0:00:02.239 ******** [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. ok: [instance] => (item=controller) TASK [reproducer : Ensure all standard attached networks are defined] ********** Friday 03 October 2025 13:20:25 +0000 (0:00:00.043) 0:00:02.283 ******** fatal: [instance]: FAILED! => changed=false assertion: _all_nets | difference(_defined) | length == 0 evaluated_to: false msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' TASK [reproducer : Dump initial layout] **************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.055) 0:00:02.338 ******** ok: [instance] => cifmw_libvirt_manager_configuration: networks: l00-s0: defined public: defined vms: controller: nets: - public spineleafnets: - l00-s0 TASK [reproducer : Dump CI reproducer generated layout] ************************ Friday 03 October 2025 13:20:25 +0000 (0:00:00.030) 0:00:02.369 ******** skipping: [instance] TASK [reproducer : Dump layout patches] **************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.026) 0:00:02.396 ******** skipping: [instance] TASK [reproducer : Dump built layout] ****************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.066) 0:00:02.462 ******** ok: [instance] => _cifmw_libvirt_manager_layout: networks: l00-s0: defined public: defined vms: controller: nets: - public spineleafnets: - l00-s0 - l00-s1 TASK [reproducer : Fail for good] ********************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.036) 0:00:02.499 ******** fatal: [instance]: FAILED! => changed=false msg: Error detected, please check assertions and debugging output above. TASK [Clear host errors] ******************************************************* Friday 03 October 2025 13:20:25 +0000 (0:00:00.026) 0:00:02.525 ******** TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.015) 0:00:02.541 ******** ok: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:25 +0000 (0:00:00.020) 0:00:02.562 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.035) 0:00:02.597 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.037) 0:00:02.635 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.036) 0:00:02.671 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.050) 0:00:02.721 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.026) 0:00:02.748 ******** ok: [instance] => msg: 'Running: No network for a VM' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:25 +0000 (0:00:00.027) 0:00:02.775 ******** TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Friday 03 October 2025 13:20:26 +0000 (0:00:00.039) 0:00:02.814 ******** [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: The loop variable 'item' is already in use. You should set the `loop_var` value in the `loop_control` option for the task to something else to avoid variable collisions and unexpected behavior. failed: [instance] (item=foo) => changed=false ansible_loop_var: item assertion: item.value.nets is defined evaluated_to: false item: key: foo value: disksize: 10 msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' ok: [instance] => (item=controller) TASK [reproducer : Dump initial layout] **************************************** Friday 03 October 2025 13:20:26 +0000 (0:00:00.051) 0:00:02.866 ******** ok: [instance] => cifmw_libvirt_manager_configuration: networks: public: defined vms: controller: nets: - public TASK [reproducer : Dump CI reproducer generated layout] ************************ Friday 03 October 2025 13:20:26 +0000 (0:00:00.034) 0:00:02.900 ******** skipping: [instance] TASK [reproducer : Dump layout patches] **************************************** Friday 03 October 2025 13:20:26 +0000 (0:00:00.029) 0:00:02.930 ******** skipping: [instance] TASK [reproducer : Dump built layout] ****************************************** Friday 03 October 2025 13:20:26 +0000 (0:00:00.071) 0:00:03.002 ******** ok: [instance] => _cifmw_libvirt_manager_layout: networks: public: defined vms: controller: nets: - public foo: disksize: 10 TASK [reproducer : Fail for good] ********************************************** Friday 03 October 2025 13:20:26 +0000 (0:00:00.044) 0:00:03.046 ******** fatal: [instance]: FAILED! => changed=false msg: Error detected, please check assertions and debugging output above. TASK [Clear host errors] ******************************************************* Friday 03 October 2025 13:20:26 +0000 (0:00:00.022) 0:00:03.068 ******** TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:26 +0000 (0:00:00.016) 0:00:03.084 ******** ok: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:26 +0000 (0:00:00.021) 0:00:03.106 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:26 +0000 (0:00:00.035) 0:00:03.142 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:26 +0000 (0:00:00.032) 0:00:03.174 ******** skipping: [instance] TASK [Fail if needed] ********************************************************** Friday 03 October 2025 13:20:26 +0000 (0:00:00.035) 0:00:03.210 ******** skipping: [instance] PLAY RECAP ********************************************************************* instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 Friday 03 October 2025 13:20:26 +0000 (0:00:00.058) 0:00:03.268 ******** =============================================================================== reproducer : Dump layout patches ---------------------------------------- 0.09s reproducer : Ensure all standard attached networks are defined ---------- 0.08s reproducer : Dump layout patches ---------------------------------------- 0.07s reproducer : Dump layout patches ---------------------------------------- 0.07s reproducer : Dump layout patches ---------------------------------------- 0.07s reproducer : Ensure we don't have extra network defined ----------------- 0.06s reproducer : Ensure we don't have extra network defined ----------------- 0.06s reproducer : Ensure all VM types have defined nets parameter ------------ 0.06s reproducer : Ensure we don't have extra network defined ----------------- 0.06s reproducer : Ensure all standard attached networks are defined ---------- 0.06s Fail if needed ---------------------------------------------------------- 0.06s Test network validations ------------------------------------------------ 0.06s reproducer : Ensure all standard attached networks are defined ---------- 0.06s reproducer : Ensure all standard attached networks are defined ---------- 0.05s reproducer : Ensure all standard attached networks are defined ---------- 0.05s reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s Mark run as failed ------------------------------------------------------ 0.05s Validate data ----------------------------------------------------------- 0.05s reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s reproducer : Dump built layout ------------------------------------------ 0.04s PLAY [Prepare] ***************************************************************** TASK [Set failed fact] ********************************************************* Friday 03 October 2025 13:20:27 +0000 (0:00:00.033) 0:00:00.033 ******** ok: [instance] TASK [Load scenarios] ********************************************************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.020) 0:00:00.054 ******** ok: [instance] TASK [Test no volumes] ********************************************************* Friday 03 October 2025 13:20:27 +0000 (0:00:00.023) 0:00:00.077 ******** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.098) 0:00:00.176 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.022) 0:00:00.198 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.024) 0:00:00.223 ******** ok: [instance] => msg: 'Running: No volume, no worker' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.024) 0:00:00.248 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:27 +0000 (0:00:00.060) 0:00:00.308 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.057) 0:00:00.365 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:27 +0000 (0:00:00.042) 0:00:00.408 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:27 +0000 (0:00:00.069) 0:00:00.477 ******** skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:27 +0000 (0:00:00.040) 0:00:00.518 ******** ok: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Friday 03 October 2025 13:20:27 +0000 (0:00:00.048) 0:00:00.566 ******** skipping: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.041) 0:00:00.608 ******** skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Friday 03 October 2025 13:20:27 +0000 (0:00:00.038) 0:00:00.646 ******** skipping: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Friday 03 October 2025 13:20:27 +0000 (0:00:00.040) 0:00:00.687 ******** skipping: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.039) 0:00:00.727 ******** skipping: [instance] TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Friday 03 October 2025 13:20:27 +0000 (0:00:00.041) 0:00:00.769 ******** skipping: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:27 +0000 (0:00:00.048) 0:00:00.817 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.037) 0:00:00.854 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.032) 0:00:00.887 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.034) 0:00:00.921 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.021) 0:00:00.943 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.026) 0:00:00.970 ******** ok: [instance] => msg: 'Running: No volume, with worker' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:27 +0000 (0:00:00.023) 0:00:00.994 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:28 +0000 (0:00:00.041) 0:00:01.036 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:28 +0000 (0:00:00.058) 0:00:01.094 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:28 +0000 (0:00:00.041) 0:00:01.135 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:28 +0000 (0:00:00.093) 0:00:01.228 ******** ok: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:28 +0000 (0:00:00.072) 0:00:01.301 ******** ok: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Friday 03 October 2025 13:20:28 +0000 (0:00:00.050) 0:00:01.352 ******** skipping: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Friday 03 October 2025 13:20:28 +0000 (0:00:00.038) 0:00:01.391 ******** skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Friday 03 October 2025 13:20:28 +0000 (0:00:00.038) 0:00:01.429 ******** skipping: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Friday 03 October 2025 13:20:28 +0000 (0:00:00.040) 0:00:01.470 ******** skipping: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Friday 03 October 2025 13:20:28 +0000 (0:00:00.039) 0:00:01.509 ******** skipping: [instance] TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Friday 03 October 2025 13:20:28 +0000 (0:00:00.041) 0:00:01.551 ******** skipping: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:28 +0000 (0:00:00.048) 0:00:01.600 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:28 +0000 (0:00:00.038) 0:00:01.638 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:28 +0000 (0:00:00.032) 0:00:01.670 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:28 +0000 (0:00:00.032) 0:00:01.702 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:28 +0000 (0:00:00.022) 0:00:01.725 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:28 +0000 (0:00:00.026) 0:00:01.751 ******** ok: [instance] => msg: 'Running: Volume, no worker' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:28 +0000 (0:00:00.023) 0:00:01.774 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:28 +0000 (0:00:00.041) 0:00:01.816 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:28 +0000 (0:00:00.062) 0:00:01.878 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:28 +0000 (0:00:00.041) 0:00:01.919 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:28 +0000 (0:00:00.072) 0:00:01.991 ******** skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:29 +0000 (0:00:00.037) 0:00:02.029 ******** skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Friday 03 October 2025 13:20:29 +0000 (0:00:00.046) 0:00:02.075 ******** ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Friday 03 October 2025 13:20:29 +0000 (0:00:00.045) 0:00:02.121 ******** skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Friday 03 October 2025 13:20:29 +0000 (0:00:00.064) 0:00:02.185 ******** ok: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Friday 03 October 2025 13:20:29 +0000 (0:00:00.065) 0:00:02.251 ******** ok: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Friday 03 October 2025 13:20:29 +0000 (0:00:00.067) 0:00:02.319 ******** ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Friday 03 October 2025 13:20:29 +0000 (0:00:00.067) 0:00:02.386 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:29 +0000 (0:00:00.080) 0:00:02.467 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:29 +0000 (0:00:00.036) 0:00:02.504 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:29 +0000 (0:00:00.034) 0:00:02.538 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:29 +0000 (0:00:00.036) 0:00:02.575 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:29 +0000 (0:00:00.021) 0:00:02.596 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:29 +0000 (0:00:00.024) 0:00:02.621 ******** ok: [instance] => msg: 'Running: Volume, with worker' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:29 +0000 (0:00:00.026) 0:00:02.648 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:29 +0000 (0:00:00.040) 0:00:02.689 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:29 +0000 (0:00:00.057) 0:00:02.746 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:29 +0000 (0:00:00.044) 0:00:02.791 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:29 +0000 (0:00:00.070) 0:00:02.861 ******** ok: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:29 +0000 (0:00:00.069) 0:00:02.931 ******** skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Friday 03 October 2025 13:20:29 +0000 (0:00:00.041) 0:00:02.972 ******** ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Friday 03 October 2025 13:20:29 +0000 (0:00:00.046) 0:00:03.019 ******** ok: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Friday 03 October 2025 13:20:30 +0000 (0:00:00.051) 0:00:03.071 ******** ok: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Friday 03 October 2025 13:20:30 +0000 (0:00:00.069) 0:00:03.140 ******** ok: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Friday 03 October 2025 13:20:30 +0000 (0:00:00.065) 0:00:03.206 ******** ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Friday 03 October 2025 13:20:30 +0000 (0:00:00.094) 0:00:03.300 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:30 +0000 (0:00:00.080) 0:00:03.380 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:30 +0000 (0:00:00.036) 0:00:03.416 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:30 +0000 (0:00:00.032) 0:00:03.448 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:30 +0000 (0:00:00.033) 0:00:03.482 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:30 +0000 (0:00:00.023) 0:00:03.505 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:30 +0000 (0:00:00.024) 0:00:03.530 ******** ok: [instance] => msg: 'Running: Too many allocated volumes' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:30 +0000 (0:00:00.024) 0:00:03.554 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:30 +0000 (0:00:00.042) 0:00:03.597 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:30 +0000 (0:00:00.057) 0:00:03.654 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:30 +0000 (0:00:00.043) 0:00:03.698 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:30 +0000 (0:00:00.071) 0:00:03.770 ******** skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:30 +0000 (0:00:00.039) 0:00:03.809 ******** skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Friday 03 October 2025 13:20:30 +0000 (0:00:00.043) 0:00:03.852 ******** ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Friday 03 October 2025 13:20:30 +0000 (0:00:00.045) 0:00:03.898 ******** skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Friday 03 October 2025 13:20:30 +0000 (0:00:00.042) 0:00:03.941 ******** fatal: [instance]: FAILED! => changed=false assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int evaluated_to: false msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' TASK [Clear host errors] ******************************************************* Friday 03 October 2025 13:20:30 +0000 (0:00:00.065) 0:00:04.007 ******** TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:30 +0000 (0:00:00.016) 0:00:04.023 ******** ok: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:31 +0000 (0:00:00.020) 0:00:04.044 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.035) 0:00:04.079 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.031) 0:00:04.110 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.077) 0:00:04.188 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.020) 0:00:04.208 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.025) 0:00:04.234 ******** ok: [instance] => msg: 'Running: Different volume amount' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.024) 0:00:04.259 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:31 +0000 (0:00:00.042) 0:00:04.301 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.059) 0:00:04.361 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:31 +0000 (0:00:00.041) 0:00:04.402 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:31 +0000 (0:00:00.074) 0:00:04.477 ******** ok: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:31 +0000 (0:00:00.069) 0:00:04.546 ******** skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Friday 03 October 2025 13:20:31 +0000 (0:00:00.043) 0:00:04.590 ******** ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.044) 0:00:04.635 ******** fatal: [instance]: FAILED! => changed=false assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 evaluated_to: false msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' TASK [Clear host errors] ******************************************************* Friday 03 October 2025 13:20:31 +0000 (0:00:00.055) 0:00:04.690 ******** TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.015) 0:00:04.706 ******** ok: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:31 +0000 (0:00:00.022) 0:00:04.729 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.035) 0:00:04.765 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.035) 0:00:04.800 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.032) 0:00:04.832 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.026) 0:00:04.859 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.026) 0:00:04.885 ******** ok: [instance] => msg: 'Running: Create LVM without volume' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:31 +0000 (0:00:00.026) 0:00:04.911 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:31 +0000 (0:00:00.041) 0:00:04.953 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.082) 0:00:05.035 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:32 +0000 (0:00:00.040) 0:00:05.075 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:32 +0000 (0:00:00.068) 0:00:05.144 ******** skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:32 +0000 (0:00:00.039) 0:00:05.183 ******** fatal: [instance]: FAILED! => changed=false assertion: not cifmw_devscripts_create_logical_volume | bool evaluated_to: false msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' TASK [Clear host errors] ******************************************************* Friday 03 October 2025 13:20:32 +0000 (0:00:00.048) 0:00:05.232 ******** TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.017) 0:00:05.249 ******** ok: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:32 +0000 (0:00:00.021) 0:00:05.270 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.036) 0:00:05.307 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.031) 0:00:05.339 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.032) 0:00:05.371 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.024) 0:00:05.396 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.024) 0:00:05.420 ******** ok: [instance] => msg: 'Running: Create LVMS without volume' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.025) 0:00:05.446 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:32 +0000 (0:00:00.041) 0:00:05.488 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.056) 0:00:05.544 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:32 +0000 (0:00:00.041) 0:00:05.585 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:32 +0000 (0:00:00.067) 0:00:05.653 ******** skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:32 +0000 (0:00:00.039) 0:00:05.693 ******** fatal: [instance]: FAILED! => changed=false assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 evaluated_to: false msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' TASK [Clear host errors] ******************************************************* Friday 03 October 2025 13:20:32 +0000 (0:00:00.049) 0:00:05.743 ******** TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.016) 0:00:05.759 ******** ok: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:32 +0000 (0:00:00.022) 0:00:05.782 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.065) 0:00:05.847 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.033) 0:00:05.881 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.033) 0:00:05.914 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.021) 0:00:05.936 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.024) 0:00:05.960 ******** ok: [instance] => msg: 'Running: Allocate same volume twice' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:32 +0000 (0:00:00.026) 0:00:05.987 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:33 +0000 (0:00:00.040) 0:00:06.027 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:33 +0000 (0:00:00.057) 0:00:06.085 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:33 +0000 (0:00:00.042) 0:00:06.128 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:33 +0000 (0:00:00.068) 0:00:06.196 ******** skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:33 +0000 (0:00:00.041) 0:00:06.238 ******** skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Friday 03 October 2025 13:20:33 +0000 (0:00:00.041) 0:00:06.280 ******** ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Friday 03 October 2025 13:20:33 +0000 (0:00:00.045) 0:00:06.325 ******** skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Friday 03 October 2025 13:20:33 +0000 (0:00:00.041) 0:00:06.367 ******** fatal: [instance]: FAILED! => changed=false assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int evaluated_to: false msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' TASK [Clear host errors] ******************************************************* Friday 03 October 2025 13:20:33 +0000 (0:00:00.069) 0:00:06.436 ******** TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:33 +0000 (0:00:00.016) 0:00:06.452 ******** ok: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:33 +0000 (0:00:00.021) 0:00:06.474 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:33 +0000 (0:00:00.035) 0:00:06.510 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:33 +0000 (0:00:00.031) 0:00:06.541 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:33 +0000 (0:00:00.032) 0:00:06.574 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:33 +0000 (0:00:00.021) 0:00:06.596 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:33 +0000 (0:00:00.024) 0:00:06.620 ******** ok: [instance] => msg: 'Running: Allocate same volume twice - no LVMS' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:33 +0000 (0:00:00.049) 0:00:06.670 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:33 +0000 (0:00:00.043) 0:00:06.714 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:33 +0000 (0:00:00.058) 0:00:06.772 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:33 +0000 (0:00:00.042) 0:00:06.814 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:33 +0000 (0:00:00.070) 0:00:06.884 ******** skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:33 +0000 (0:00:00.039) 0:00:06.924 ******** skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Friday 03 October 2025 13:20:33 +0000 (0:00:00.043) 0:00:06.967 ******** ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Friday 03 October 2025 13:20:33 +0000 (0:00:00.044) 0:00:07.011 ******** skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Friday 03 October 2025 13:20:34 +0000 (0:00:00.040) 0:00:07.052 ******** ok: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Friday 03 October 2025 13:20:34 +0000 (0:00:00.065) 0:00:07.118 ******** skipping: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Friday 03 October 2025 13:20:34 +0000 (0:00:00.049) 0:00:07.168 ******** ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Friday 03 October 2025 13:20:34 +0000 (0:00:00.070) 0:00:07.239 ******** ok: [instance] => changed=false msg: All assertions passed TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:34 +0000 (0:00:00.079) 0:00:07.318 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:34 +0000 (0:00:00.035) 0:00:07.353 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:34 +0000 (0:00:00.033) 0:00:07.387 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:34 +0000 (0:00:00.035) 0:00:07.422 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:34 +0000 (0:00:00.023) 0:00:07.445 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:34 +0000 (0:00:00.024) 0:00:07.470 ******** ok: [instance] => msg: 'Running: Allocate same volume twice - no cinder_lvm' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:34 +0000 (0:00:00.022) 0:00:07.493 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:34 +0000 (0:00:00.040) 0:00:07.534 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:34 +0000 (0:00:00.088) 0:00:07.622 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:34 +0000 (0:00:00.041) 0:00:07.663 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:34 +0000 (0:00:00.070) 0:00:07.734 ******** skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:34 +0000 (0:00:00.038) 0:00:07.772 ******** skipping: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Friday 03 October 2025 13:20:34 +0000 (0:00:00.040) 0:00:07.812 ******** ok: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Friday 03 October 2025 13:20:34 +0000 (0:00:00.045) 0:00:07.857 ******** skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Friday 03 October 2025 13:20:34 +0000 (0:00:00.040) 0:00:07.898 ******** ok: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Friday 03 October 2025 13:20:34 +0000 (0:00:00.067) 0:00:07.966 ******** skipping: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Friday 03 October 2025 13:20:34 +0000 (0:00:00.051) 0:00:08.018 ******** ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Friday 03 October 2025 13:20:35 +0000 (0:00:00.072) 0:00:08.090 ******** skipping: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:35 +0000 (0:00:00.062) 0:00:08.153 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.037) 0:00:08.190 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.032) 0:00:08.222 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.031) 0:00:08.254 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.021) 0:00:08.276 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.024) 0:00:08.300 ******** ok: [instance] => msg: 'Running: Config overrides via devscripts' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.024) 0:00:08.324 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:35 +0000 (0:00:00.045) 0:00:08.370 ******** fatal: [instance]: FAILED! => changed=false assertion: cifmw_devscripts_config.master_memory is undefined evaluated_to: false msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' TASK [Clear host errors] ******************************************************* Friday 03 October 2025 13:20:35 +0000 (0:00:00.042) 0:00:08.412 ******** TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.015) 0:00:08.428 ******** ok: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:35 +0000 (0:00:00.020) 0:00:08.449 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.034) 0:00:08.483 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.061) 0:00:08.544 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.031) 0:00:08.576 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.022) 0:00:08.599 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.025) 0:00:08.624 ******** ok: [instance] => msg: 'Running: Inject 10 dev-scripts extra_worker' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.025) 0:00:08.650 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:35 +0000 (0:00:00.041) 0:00:08.692 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.057) 0:00:08.750 ******** fatal: [instance]: FAILED! => changed=false assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 evaluated_to: false msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' TASK [Clear host errors] ******************************************************* Friday 03 October 2025 13:20:35 +0000 (0:00:00.044) 0:00:08.795 ******** TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.015) 0:00:08.810 ******** ok: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:35 +0000 (0:00:00.021) 0:00:08.832 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.037) 0:00:08.869 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.032) 0:00:08.902 ******** skipping: [instance] TASK [Mark run as failed] ****************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.030) 0:00:08.932 ******** ok: [instance] TASK [Load environment file] *************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.021) 0:00:08.953 ******** ok: [instance] TASK [Output scenario name] **************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.028) 0:00:08.981 ******** ok: [instance] => msg: 'Running: Inject 0 dev-scripts extra_worker' TASK [Validate data] *********************************************************** Friday 03 October 2025 13:20:35 +0000 (0:00:00.027) 0:00:09.009 ******** TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** Friday 03 October 2025 13:20:36 +0000 (0:00:00.041) 0:00:09.050 ******** ok: [instance] TASK [reproducer : Ensure we don't try to create extra_workers] **************** Friday 03 October 2025 13:20:36 +0000 (0:00:00.057) 0:00:09.108 ******** ok: [instance] TASK [reproducer : Ensure we get required data in the layout description] ****** Friday 03 October 2025 13:20:36 +0000 (0:00:00.041) 0:00:09.149 ******** ok: [instance] TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* Friday 03 October 2025 13:20:36 +0000 (0:00:00.068) 0:00:09.218 ******** skipping: [instance] TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** Friday 03 October 2025 13:20:36 +0000 (0:00:00.038) 0:00:09.257 ******** ok: [instance] TASK [reproducer : Ensure we get disk_size] ************************************ Friday 03 October 2025 13:20:36 +0000 (0:00:00.114) 0:00:09.371 ******** skipping: [instance] TASK [reproducer : Ensure same amount of disks are created] ******************** Friday 03 October 2025 13:20:36 +0000 (0:00:00.042) 0:00:09.413 ******** skipping: [instance] TASK [reproducer : Ensure created amount matches at least allocated amounts] *** Friday 03 October 2025 13:20:36 +0000 (0:00:00.041) 0:00:09.455 ******** skipping: [instance] TASK [reproducer : Ensure no allocation overlap] ******************************* Friday 03 October 2025 13:20:36 +0000 (0:00:00.037) 0:00:09.492 ******** skipping: [instance] TASK [reproducer : Ensure LVMS allocated disks are available] ****************** Friday 03 October 2025 13:20:36 +0000 (0:00:00.042) 0:00:09.534 ******** skipping: [instance] TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ Friday 03 October 2025 13:20:36 +0000 (0:00:00.041) 0:00:09.576 ******** skipping: [instance] TASK [Mark failure] ************************************************************ Friday 03 October 2025 13:20:36 +0000 (0:00:00.050) 0:00:09.626 ******** skipping: [instance] TASK [Display error message] *************************************************** Friday 03 October 2025 13:20:36 +0000 (0:00:00.036) 0:00:09.663 ******** skipping: [instance] TASK [Append failed scenario to list] ****************************************** Friday 03 October 2025 13:20:36 +0000 (0:00:00.034) 0:00:09.697 ******** skipping: [instance] TASK [Fail if needed] ********************************************************** Friday 03 October 2025 13:20:36 +0000 (0:00:00.033) 0:00:09.731 ******** skipping: [instance] PLAY RECAP ********************************************************************* instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 Friday 03 October 2025 13:20:36 +0000 (0:00:00.067) 0:00:09.798 ******** =============================================================================== reproducer : Ensure we don't set some parameters when no extra disks ---- 0.11s Test no volumes --------------------------------------------------------- 0.10s reproducer : Ensure LVMS allocated disks are available ------------------ 0.09s reproducer : Ensure we get required data in the layout description ------ 0.09s reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.09s reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.08s reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s Append failed scenario to list ------------------------------------------ 0.08s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.07s reproducer : Ensure LVMS allocated disks are available ------------------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure LVMS allocated disks are available ------------------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure we get required data in the layout description ------ 0.07s reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.07s