PLAY [Prepare] ***************************************************************** TASK [Gathering Facts] ********************************************************* Monday 16 March 2026 14:28:28 +0000 (0:00:00.020) 0:00:00.020 ********** ok: [instance] TASK [Create custom basedir] *************************************************** Monday 16 March 2026 14:28:29 +0000 (0:00:00.854) 0:00:00.874 ********** changed: [instance] TASK [test_deps : Gather facts if they don't exist] **************************** Monday 16 March 2026 14:28:29 +0000 (0:00:00.327) 0:00:01.202 ********** skipping: [instance] TASK [test_deps : Gather variables for each operating system] ****************** Monday 16 March 2026 14:28:29 +0000 (0:00:00.020) 0:00:01.223 ********** ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) TASK [test_deps : Detect mirrors file] ***************************************** Monday 16 March 2026 14:28:29 +0000 (0:00:00.043) 0:00:01.266 ********** ok: [instance] TASK [test_deps : Disable ubi host subscription-manager integration] *********** Monday 16 March 2026 14:28:30 +0000 (0:00:00.312) 0:00:01.578 ********** ok: [instance] TASK [test_deps : Disable ubi 9 repos] ***************************************** Monday 16 March 2026 14:28:30 +0000 (0:00:00.232) 0:00:01.811 ********** ok: [instance] => (item=ubi-9-appstream) ok: [instance] => (item=ubi-9-baseos) ok: [instance] => (item=ubi-9-codeready-builder) TASK [Deploy repo-setup] ******************************************************* Monday 16 March 2026 14:28:31 +0000 (0:00:00.687) 0:00:02.498 ********** TASK [repo_setup : Ensure directories are present] ***************************** Monday 16 March 2026 14:28:31 +0000 (0:00:00.059) 0:00:02.558 ********** changed: [instance] => (item=tmp) changed: [instance] => (item=artifacts/repositories) changed: [instance] => (item=venv/repo_setup) TASK [repo_setup : Make sure git-core package is installed] ******************** Monday 16 March 2026 14:28:31 +0000 (0:00:00.528) 0:00:03.086 ********** ok: [instance] TASK [repo_setup : Get repo-setup repository] ********************************** Monday 16 March 2026 14:28:32 +0000 (0:00:00.936) 0:00:04.023 ********** changed: [instance] TASK [repo_setup : Initialize python venv and install requirements] ************ Monday 16 March 2026 14:28:33 +0000 (0:00:01.127) 0:00:05.150 ********** changed: [instance] TASK [repo_setup : Install repo-setup package] ********************************* Monday 16 March 2026 14:28:41 +0000 (0:00:07.457) 0:00:12.608 ********** changed: [instance] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Monday 16 March 2026 14:28:42 +0000 (0:00:00.727) 0:00:13.336 ********** skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Monday 16 March 2026 14:28:42 +0000 (0:00:00.034) 0:00:13.370 ********** changed: [instance] TASK [repo_setup : Get component repo] ***************************************** Monday 16 March 2026 14:28:42 +0000 (0:00:00.831) 0:00:14.202 ********** skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Monday 16 March 2026 14:28:42 +0000 (0:00:00.041) 0:00:14.243 ********** skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Monday 16 March 2026 14:28:42 +0000 (0:00:00.039) 0:00:14.282 ********** skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Monday 16 March 2026 14:28:43 +0000 (0:00:00.036) 0:00:14.319 ********** changed: [instance] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Monday 16 March 2026 14:28:43 +0000 (0:00:00.559) 0:00:14.879 ********** changed: [instance] TASK [repo_setup : Dump current-podified hash] ********************************* Monday 16 March 2026 14:28:44 +0000 (0:00:00.444) 0:00:15.324 ********** skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Monday 16 March 2026 14:28:44 +0000 (0:00:00.029) 0:00:15.353 ********** skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Monday 16 March 2026 14:28:44 +0000 (0:00:00.030) 0:00:15.384 ********** skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Monday 16 March 2026 14:28:44 +0000 (0:00:00.030) 0:00:15.414 ********** ok: [instance] TASK [repo_setup : Create download directory] ********************************** Monday 16 March 2026 14:28:44 +0000 (0:00:00.038) 0:00:15.452 ********** skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Monday 16 March 2026 14:28:44 +0000 (0:00:00.027) 0:00:15.480 ********** skipping: [instance] TASK [Download the RPM] ******************************************************** Monday 16 March 2026 14:28:44 +0000 (0:00:00.028) 0:00:15.508 ********** skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Monday 16 March 2026 14:28:44 +0000 (0:00:00.027) 0:00:15.536 ********** skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Monday 16 March 2026 14:28:44 +0000 (0:00:00.027) 0:00:15.563 ********** skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Monday 16 March 2026 14:28:44 +0000 (0:00:00.026) 0:00:15.590 ********** skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Monday 16 March 2026 14:28:44 +0000 (0:00:00.028) 0:00:15.618 ********** skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Monday 16 March 2026 14:28:44 +0000 (0:00:00.025) 0:00:15.644 ********** ok: [instance] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Monday 16 March 2026 14:28:44 +0000 (0:00:00.191) 0:00:15.835 ********** changed: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Monday 16 March 2026 14:28:44 +0000 (0:00:00.227) 0:00:16.063 ********** changed: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Monday 16 March 2026 14:28:44 +0000 (0:00:00.241) 0:00:16.304 ********** skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Monday 16 March 2026 14:28:45 +0000 (0:00:00.030) 0:00:16.335 ********** skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Monday 16 March 2026 14:28:45 +0000 (0:00:00.029) 0:00:16.364 ********** skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Monday 16 March 2026 14:28:45 +0000 (0:00:00.028) 0:00:16.393 ********** skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Monday 16 March 2026 14:28:45 +0000 (0:00:00.025) 0:00:16.419 ********** skipping: [instance] TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** Monday 16 March 2026 14:28:45 +0000 (0:00:00.025) 0:00:16.444 ********** skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Monday 16 March 2026 14:28:45 +0000 (0:00:00.023) 0:00:16.468 ********** skipping: [instance] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Monday 16 March 2026 14:28:45 +0000 (0:00:00.018) 0:00:16.486 ********** skipping: [instance] TASK [repo_setup : Cleanup existing metadata] ********************************** Monday 16 March 2026 14:28:45 +0000 (0:00:00.030) 0:00:16.516 ********** skipping: [instance] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Monday 16 March 2026 14:28:45 +0000 (0:00:00.018) 0:00:16.535 ********** skipping: [instance] TASK [test_deps : Look for redhat-release rpm] ********************************* Monday 16 March 2026 14:28:45 +0000 (0:00:00.019) 0:00:16.555 ********** skipping: [instance] TASK [test_deps : Remove redhat-release] *************************************** Monday 16 March 2026 14:28:45 +0000 (0:00:00.041) 0:00:16.596 ********** skipping: [instance] TASK [test_deps : Install centos-stream-release] ******************************* Monday 16 March 2026 14:28:45 +0000 (0:00:00.033) 0:00:16.629 ********** skipping: [instance] TASK [test_deps : Install additional packages] ********************************* Monday 16 March 2026 14:28:45 +0000 (0:00:00.031) 0:00:16.661 ********** skipping: [instance] TASK [test_deps : Install selinux python libs] ********************************* Monday 16 March 2026 14:28:45 +0000 (0:00:00.029) 0:00:16.691 ********** ok: [instance] TASK [test_deps : Install python yaml libs] ************************************ Monday 16 March 2026 14:29:27 +0000 (0:00:42.602) 0:00:59.293 ********** ok: [instance] TASK [test_deps : Install extra packages] ************************************** Monday 16 March 2026 14:29:29 +0000 (0:00:01.189) 0:01:00.483 ********** skipping: [instance] TASK [ci_setup : Gather variables for each operating system] ******************* Monday 16 March 2026 14:29:29 +0000 (0:00:00.030) 0:01:00.513 ********** ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) TASK [ci_setup : List packages to install] ************************************* Monday 16 March 2026 14:29:29 +0000 (0:00:00.040) 0:01:00.554 ********** ok: [instance] => cifmw_ci_setup_packages: - bash-completion - ca-certificates - git-core - make - tar - tmux - python3-pip TASK [ci_setup : Install needed packages] ************************************** Monday 16 March 2026 14:29:29 +0000 (0:00:00.018) 0:01:00.572 ********** changed: [instance] TASK [ci_setup : Gather version of openshift client] *************************** Monday 16 March 2026 14:29:34 +0000 (0:00:04.871) 0:01:05.443 ********** ok: [instance] TASK [ci_setup : Ensure openshift client install path is present] ************** Monday 16 March 2026 14:29:34 +0000 (0:00:00.534) 0:01:05.978 ********** changed: [instance] TASK [ci_setup : Install openshift client] ************************************* Monday 16 March 2026 14:29:34 +0000 (0:00:00.194) 0:01:06.173 ********** changed: [instance] TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** Monday 16 March 2026 14:29:41 +0000 (0:00:06.176) 0:01:12.349 ********** ok: [instance] TASK [ci_setup : Create completion file] *************************************** Monday 16 March 2026 14:29:41 +0000 (0:00:00.037) 0:01:12.386 ********** changed: [instance] TASK [ci_setup : Source completion from within .bashrc] ************************ Monday 16 March 2026 14:29:41 +0000 (0:00:00.265) 0:01:12.652 ********** changed: [instance] TASK [ci_setup : Check rhsm status] ******************************************** Monday 16 March 2026 14:29:41 +0000 (0:00:00.282) 0:01:12.934 ********** skipping: [instance] TASK [ci_setup : Gather the repos to be enabled] ******************************* Monday 16 March 2026 14:29:41 +0000 (0:00:00.017) 0:01:12.952 ********** skipping: [instance] TASK [ci_setup : Enabling the required repositories.] ************************** Monday 16 March 2026 14:29:41 +0000 (0:00:00.016) 0:01:12.969 ********** skipping: [instance] TASK [ci_setup : Get current /etc/redhat-release] ****************************** Monday 16 March 2026 14:29:41 +0000 (0:00:00.016) 0:01:12.985 ********** skipping: [instance] TASK [ci_setup : Print current /etc/redhat-release] **************************** Monday 16 March 2026 14:29:41 +0000 (0:00:00.016) 0:01:13.002 ********** skipping: [instance] TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* Monday 16 March 2026 14:29:41 +0000 (0:00:00.015) 0:01:13.018 ********** skipping: [instance] TASK [ci_setup : Manage directories] ******************************************* Monday 16 March 2026 14:29:41 +0000 (0:00:00.021) 0:01:13.039 ********** changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) changed: [instance] => (item=/opt/basedir/logs) ok: [instance] => (item=/opt/basedir/tmp) changed: [instance] => (item=/opt/basedir/volumes) changed: [instance] => (item=/opt/basedir/artifacts/parameters) TASK [Create secret file] ****************************************************** Monday 16 March 2026 14:29:42 +0000 (0:00:00.929) 0:01:13.969 ********** changed: [instance] PLAY RECAP ********************************************************************* instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 Monday 16 March 2026 14:29:42 +0000 (0:00:00.318) 0:01:14.287 ********** =============================================================================== test_deps : Install selinux python libs -------------------------------- 42.60s repo_setup : Initialize python venv and install requirements ------------ 7.46s ci_setup : Install openshift client ------------------------------------- 6.18s ci_setup : Install needed packages -------------------------------------- 4.87s test_deps : Install python yaml libs ------------------------------------ 1.19s repo_setup : Get repo-setup repository ---------------------------------- 1.13s repo_setup : Make sure git-core package is installed -------------------- 0.94s ci_setup : Manage directories ------------------------------------------- 0.93s Gathering Facts --------------------------------------------------------- 0.85s repo_setup : Run repo-setup --------------------------------------------- 0.83s repo_setup : Install repo-setup package --------------------------------- 0.73s test_deps : Disable ubi 9 repos ----------------------------------------- 0.69s repo_setup : Run repo-setup-get-hash ------------------------------------ 0.56s ci_setup : Gather version of openshift client --------------------------- 0.53s repo_setup : Ensure directories are present ----------------------------- 0.53s repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.44s Create custom basedir --------------------------------------------------- 0.33s Create secret file ------------------------------------------------------ 0.32s test_deps : Detect mirrors file ----------------------------------------- 0.31s ci_setup : Source completion from within .bashrc ------------------------ 0.28s PLAY [Converge] **************************************************************** TASK [Gathering Facts] ********************************************************* Monday 16 March 2026 14:29:43 +0000 (0:00:00.025) 0:00:00.025 ********** ok: [instance] TASK [Load networking definition from scenario file] *************************** Monday 16 March 2026 14:29:44 +0000 (0:00:00.794) 0:00:00.820 ********** ok: [instance] TASK [discover_latest_image : Set the discovered image vars to empty/null] ***** Monday 16 March 2026 14:29:44 +0000 (0:00:00.020) 0:00:00.841 ********** ok: [instance] TASK [discover_latest_image : Discover images] ********************************* Monday 16 March 2026 14:29:44 +0000 (0:00:00.017) 0:00:00.858 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/discover_latest_image/tasks/per-image.yml for instance => (item={'key': 'default', 'value': {'base_url': 'https://cloud.centos.org/centos/9-stream/x86_64/images/', 'qcow_prefix': 'CentOS-Stream-GenericCloud-', 'images_file': 'CHECKSUM'}}) TASK [discover_latest_image : Ensure the current image dict entry has the expected data] *** Monday 16 March 2026 14:29:44 +0000 (0:00:00.038) 0:00:00.897 ********** ok: [instance] => changed=false msg: All assertions passed TASK [discover_latest_image : Get latest image for the current entry] ********** Monday 16 March 2026 14:29:44 +0000 (0:00:00.041) 0:00:00.938 ********** changed: [instance] TASK [discover_latest_image : Append the current return value to the discovered images dict] *** Monday 16 March 2026 14:29:46 +0000 (0:00:01.680) 0:00:02.618 ********** ok: [instance] TASK [discover_latest_image : Export single-image facts if an image with name 'default' was discovered] *** Monday 16 March 2026 14:29:46 +0000 (0:00:00.032) 0:00:02.651 ********** ok: [instance] TASK [reproducer : Load CI job environment] ************************************ Monday 16 March 2026 14:29:46 +0000 (0:00:00.033) 0:00:02.684 ********** skipping: [instance] TASK [Build final libvirt layout] ********************************************** Monday 16 March 2026 14:29:46 +0000 (0:00:00.022) 0:00:02.707 ********** TASK [libvirt_manager : Chose right parameter for layout definition] *********** Monday 16 March 2026 14:29:46 +0000 (0:00:00.048) 0:00:02.755 ********** ok: [instance] TASK [libvirt_manager : Patch the layout if needed] **************************** Monday 16 March 2026 14:29:46 +0000 (0:00:00.077) 0:00:02.832 ********** skipping: [instance] TASK [reproducer : Assert no conflicting parameters were passed] *************** Monday 16 March 2026 14:29:46 +0000 (0:00:00.063) 0:00:02.895 ********** ok: [instance] TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** Monday 16 March 2026 14:29:46 +0000 (0:00:00.027) 0:00:02.922 ********** ok: [instance] => changed=false msg: All assertions passed TASK [reproducer : Set _use_crc based on actual layout] ************************ Monday 16 March 2026 14:29:46 +0000 (0:00:00.023) 0:00:02.946 ********** ok: [instance] TASK [reproducer : Ensure directories are present] ***************************** Monday 16 March 2026 14:29:46 +0000 (0:00:00.039) 0:00:02.986 ********** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [Bootstrap libvirt if needed] ********************************************* Monday 16 March 2026 14:29:47 +0000 (0:00:00.443) 0:00:03.429 ********** TASK [libvirt_manager : Ensure output directory exists] ************************ Monday 16 March 2026 14:29:47 +0000 (0:00:00.075) 0:00:03.504 ********** ok: [instance] TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* Monday 16 March 2026 14:29:47 +0000 (0:00:00.175) 0:00:03.680 ********** changed: [instance] TASK [libvirt_manager : Check if KVM is enabled] ******************************* Monday 16 March 2026 14:29:47 +0000 (0:00:00.268) 0:00:03.948 ********** ok: [instance] TASK [libvirt_manager : Fail if KVM not enabled] ******************************* Monday 16 March 2026 14:29:47 +0000 (0:00:00.270) 0:00:04.218 ********** skipping: [instance] TASK [libvirt_manager : Check if VMX virtualization] *************************** Monday 16 March 2026 14:29:47 +0000 (0:00:00.030) 0:00:04.248 ********** skipping: [instance] TASK [libvirt_manager : Check if SVM virtualization] *************************** Monday 16 March 2026 14:29:47 +0000 (0:00:00.018) 0:00:04.267 ********** ok: [instance] TASK [libvirt_manager : Enable VMX virtualization] ***************************** Monday 16 March 2026 14:29:47 +0000 (0:00:00.021) 0:00:04.288 ********** skipping: [instance] TASK [libvirt_manager : Install packages required for using KVM] *************** Monday 16 March 2026 14:29:47 +0000 (0:00:00.030) 0:00:04.319 ********** changed: [instance] TASK [libvirt_manager : Create rules.d polkit folder] ************************** Monday 16 March 2026 14:30:00 +0000 (0:00:12.717) 0:00:17.037 ********** changed: [instance] TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* Monday 16 March 2026 14:30:00 +0000 (0:00:00.244) 0:00:17.281 ********** changed: [instance] TASK [libvirt_manager : Restart service polkit service] ************************ Monday 16 March 2026 14:30:01 +0000 (0:00:00.551) 0:00:17.833 ********** changed: [instance] TASK [libvirt_manager : Remove directory for service override] ***************** Monday 16 March 2026 14:30:02 +0000 (0:00:00.594) 0:00:18.427 ********** ok: [instance] TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** Monday 16 March 2026 14:30:02 +0000 (0:00:00.210) 0:00:18.637 ********** ok: [instance] TASK [libvirt_manager : Ensure firewalld service is up] ************************ Monday 16 March 2026 14:30:02 +0000 (0:00:00.715) 0:00:19.353 ********** changed: [instance] TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** Monday 16 March 2026 14:30:03 +0000 (0:00:00.852) 0:00:20.206 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* Monday 16 March 2026 14:30:03 +0000 (0:00:00.111) 0:00:20.317 ********** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** Monday 16 March 2026 14:30:04 +0000 (0:00:00.344) 0:00:20.662 ********** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** Monday 16 March 2026 14:30:04 +0000 (0:00:00.371) 0:00:21.033 ********** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** Monday 16 March 2026 14:30:04 +0000 (0:00:00.354) 0:00:21.388 ********** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** Monday 16 March 2026 14:30:05 +0000 (0:00:00.356) 0:00:21.744 ********** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* Monday 16 March 2026 14:30:05 +0000 (0:00:00.344) 0:00:22.089 ********** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** Monday 16 March 2026 14:30:06 +0000 (0:00:00.356) 0:00:22.446 ********** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* Monday 16 March 2026 14:30:06 +0000 (0:00:00.358) 0:00:22.804 ********** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** Monday 16 March 2026 14:30:06 +0000 (0:00:00.345) 0:00:23.150 ********** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** Monday 16 March 2026 14:30:07 +0000 (0:00:00.332) 0:00:23.482 ********** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* Monday 16 March 2026 14:30:07 +0000 (0:00:00.336) 0:00:23.819 ********** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** Monday 16 March 2026 14:30:07 +0000 (0:00:00.348) 0:00:24.167 ********** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** Monday 16 March 2026 14:30:08 +0000 (0:00:00.371) 0:00:24.539 ********** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** Monday 16 March 2026 14:30:08 +0000 (0:00:00.347) 0:00:24.887 ********** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** Monday 16 March 2026 14:30:08 +0000 (0:00:00.371) 0:00:25.258 ********** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* Monday 16 March 2026 14:30:09 +0000 (0:00:00.363) 0:00:25.622 ********** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** Monday 16 March 2026 14:30:09 +0000 (0:00:00.339) 0:00:25.962 ********** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ Monday 16 March 2026 14:30:09 +0000 (0:00:00.340) 0:00:26.302 ********** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** Monday 16 March 2026 14:30:10 +0000 (0:00:00.360) 0:00:26.663 ********** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* Monday 16 March 2026 14:30:10 +0000 (0:00:00.357) 0:00:27.020 ********** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** Monday 16 March 2026 14:30:10 +0000 (0:00:00.350) 0:00:27.371 ********** ok: [instance] TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** Monday 16 March 2026 14:30:11 +0000 (0:00:00.365) 0:00:27.736 ********** ok: [instance] TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* Monday 16 March 2026 14:30:11 +0000 (0:00:00.347) 0:00:28.083 ********** ok: [instance] TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* Monday 16 March 2026 14:30:12 +0000 (0:00:00.362) 0:00:28.446 ********** ok: [instance] TASK [libvirt_manager : Manage service for older releases] ********************* Monday 16 March 2026 14:30:12 +0000 (0:00:00.353) 0:00:28.800 ********** skipping: [instance] TASK [libvirt_manager : Get libvirt group users] ******************************* Monday 16 March 2026 14:30:12 +0000 (0:00:00.026) 0:00:28.826 ********** ok: [instance] TASK [libvirt_manager : Add user if not exists in libvirt group] *************** Monday 16 March 2026 14:30:12 +0000 (0:00:00.295) 0:00:29.122 ********** ok: [instance] TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** Monday 16 March 2026 14:30:13 +0000 (0:00:00.422) 0:00:29.544 ********** changed: [instance] TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* Monday 16 March 2026 14:30:13 +0000 (0:00:00.349) 0:00:29.893 ********** [WARNING]: Reset is not implemented for this connection changed: [instance] TASK [libvirt_manager : Ensure we reload user env] ***************************** Monday 16 March 2026 14:30:13 +0000 (0:00:00.287) 0:00:30.181 ********** TASK [reproducer : Deploy networks in libvirt] ********************************* Monday 16 March 2026 14:30:13 +0000 (0:00:00.015) 0:00:30.197 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance TASK [reproducer : Ensure networks are consistent] ***************************** Monday 16 March 2026 14:30:13 +0000 (0:00:00.116) 0:00:30.314 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance TASK [reproducer : Ensure all VM types have defined nets parameter] ************ Monday 16 March 2026 14:30:13 +0000 (0:00:00.048) 0:00:30.362 ********** ok: [instance] => (item=compute) ok: [instance] => (item=controller) ok: [instance] => (item=crc) TASK [reproducer : Ensure all standard attached networks are defined] ********** Monday 16 March 2026 14:30:13 +0000 (0:00:00.052) 0:00:30.415 ********** ok: [instance] TASK [reproducer : Ensure we don't have extra network defined] ***************** Monday 16 March 2026 14:30:14 +0000 (0:00:00.053) 0:00:30.469 ********** ok: [instance] => changed=false msg: All assertions passed TASK [Ensure we get latest OCP config] ***************************************** Monday 16 March 2026 14:30:14 +0000 (0:00:00.050) 0:00:30.520 ********** TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** Monday 16 March 2026 14:30:14 +0000 (0:00:00.049) 0:00:30.569 ********** ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.54', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) ok: [instance] => (item={}) TASK [devscripts : Check if num_masters is equal to 1 when cifmw_devscripts_sno] *** Monday 16 March 2026 14:30:14 +0000 (0:00:00.088) 0:00:30.658 ********** skipping: [instance] TASK [devscripts : Replace OCP version if "stable-" alias used] **************** Monday 16 March 2026 14:30:14 +0000 (0:00:00.036) 0:00:30.694 ********** skipping: [instance] TASK [devscripts : Ensure output directory exists] ***************************** Monday 16 March 2026 14:30:14 +0000 (0:00:00.023) 0:00:30.717 ********** ok: [instance] TASK [devscripts : Output built config for easier debugging] ******************* Monday 16 March 2026 14:30:14 +0000 (0:00:00.234) 0:00:30.952 ********** changed: [instance] TASK [ci_network : Remove the local dns configuration] ************************* Monday 16 March 2026 14:30:14 +0000 (0:00:00.372) 0:00:31.324 ********** ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) TASK [ci_network : Reload the NetworkManager to pick the changes] ************** Monday 16 March 2026 14:30:15 +0000 (0:00:00.760) 0:00:32.085 ********** skipping: [instance] TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* Monday 16 March 2026 14:30:15 +0000 (0:00:00.029) 0:00:32.114 ********** changed: [instance] TASK [reproducer : Flush handlers for NetworkManager restart] ****************** Monday 16 March 2026 14:30:16 +0000 (0:00:00.390) 0:00:32.504 ********** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Monday 16 March 2026 14:30:16 +0000 (0:00:00.008) 0:00:32.512 ********** changed: [instance] TASK [Ensure no default networks exists] *************************************** Monday 16 March 2026 14:30:16 +0000 (0:00:00.472) 0:00:32.985 ********** TASK [libvirt_manager : Deactivate crc] **************************************** Monday 16 March 2026 14:30:16 +0000 (0:00:00.075) 0:00:33.060 ********** ok: [instance] TASK [libvirt_manager : Removing crc] ****************************************** Monday 16 March 2026 14:30:17 +0000 (0:00:01.231) 0:00:34.292 ********** ok: [instance] TASK [libvirt_manager : Deactivate default] ************************************ Monday 16 March 2026 14:30:18 +0000 (0:00:00.234) 0:00:34.526 ********** ok: [instance] TASK [libvirt_manager : Removing default] ************************************** Monday 16 March 2026 14:30:18 +0000 (0:00:00.560) 0:00:35.087 ********** ok: [instance] TASK [reproducer : Ensure firewalld is installed] ****************************** Monday 16 March 2026 14:30:18 +0000 (0:00:00.218) 0:00:35.306 ********** ok: [instance] TASK [reproducer : Ensure firewalld service is enabled and started] ************ Monday 16 March 2026 14:30:20 +0000 (0:00:01.201) 0:00:36.508 ********** ok: [instance] TASK [reproducer : Ensure br_netfilter module is loaded] *********************** Monday 16 March 2026 14:30:20 +0000 (0:00:00.313) 0:00:36.821 ********** changed: [instance] TASK [reproducer : Ensure IP forwarding is enabled] **************************** Monday 16 March 2026 14:30:20 +0000 (0:00:00.308) 0:00:37.130 ********** changed: [instance] TASK [reproducer : Ensure the required parameters are loaded] ****************** Monday 16 March 2026 14:30:22 +0000 (0:00:01.295) 0:00:38.425 ********** changed: [instance] => (item=arptables) changed: [instance] => (item=iptables) changed: [instance] => (item=ip6tables) TASK [reproducer : Ensure firewall service is enabled and started] ************* Monday 16 March 2026 14:30:24 +0000 (0:00:02.552) 0:00:40.978 ********** ok: [instance] TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* Monday 16 March 2026 14:30:24 +0000 (0:00:00.326) 0:00:41.305 ********** ok: [instance] TASK [Ensure the required network configurations are applied] ****************** Monday 16 March 2026 14:30:24 +0000 (0:00:00.089) 0:00:41.395 ********** TASK [networking_mapper : Check for Networking Environment Definition file existence] *** Monday 16 March 2026 14:30:25 +0000 (0:00:00.042) 0:00:41.437 ********** skipping: [instance] TASK [networking_mapper : Check for Networking Definition file existance] ****** Monday 16 March 2026 14:30:25 +0000 (0:00:00.021) 0:00:41.459 ********** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Monday 16 March 2026 14:30:25 +0000 (0:00:00.023) 0:00:41.483 ********** skipping: [instance] TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** Monday 16 March 2026 14:30:25 +0000 (0:00:00.022) 0:00:41.505 ********** skipping: [instance] TASK [ci_nmstate : Initialize NMstates for each instance] ********************** Monday 16 March 2026 14:30:25 +0000 (0:00:00.025) 0:00:41.530 ********** ok: [instance] TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** Monday 16 March 2026 14:30:25 +0000 (0:00:00.036) 0:00:41.567 ********** skipping: [instance] TASK [ci_nmstate : Get k8s nodes] ********************************************** Monday 16 March 2026 14:30:25 +0000 (0:00:00.031) 0:00:41.598 ********** skipping: [instance] TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** Monday 16 March 2026 14:30:25 +0000 (0:00:00.020) 0:00:41.619 ********** ok: [instance] TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* Monday 16 March 2026 14:30:25 +0000 (0:00:00.055) 0:00:41.674 ********** skipping: [instance] TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* Monday 16 March 2026 14:30:25 +0000 (0:00:00.022) 0:00:41.697 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) TASK [ci_nmstate : Ensure we have needed facts] ******************************** Monday 16 March 2026 14:30:25 +0000 (0:00:00.046) 0:00:41.743 ********** ok: [instance -> localhost] TASK [ci_nmstate : Install required packages on localhost] ********************* Monday 16 March 2026 14:30:25 +0000 (0:00:00.310) 0:00:42.053 ********** changed: [instance -> localhost] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Monday 16 March 2026 14:30:33 +0000 (0:00:08.018) 0:00:50.072 ********** changed: [instance] TASK [ci_nmstate : Save nmstate state for localhost] *************************** Monday 16 March 2026 14:30:33 +0000 (0:00:00.180) 0:00:50.253 ********** changed: [instance] TASK [ci_nmstate : Apply the desidered state on localhost] ********************* Monday 16 March 2026 14:30:34 +0000 (0:00:00.325) 0:00:50.579 ********** changed: [instance -> localhost] TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** Monday 16 March 2026 14:30:35 +0000 (0:00:01.597) 0:00:52.176 ********** changed: [instance] TASK [reproducer : Select right domain] **************************************** Monday 16 March 2026 14:30:36 +0000 (0:00:00.326) 0:00:52.503 ********** ok: [instance] TASK [Create the virtual networks] ********************************************* Monday 16 March 2026 14:30:36 +0000 (0:00:00.028) 0:00:52.531 ********** TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** Monday 16 March 2026 14:30:36 +0000 (0:00:00.111) 0:00:52.643 ********** ok: [instance] TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* Monday 16 March 2026 14:30:36 +0000 (0:00:00.016) 0:00:52.659 ********** ok: [instance] TASK [libvirt_manager : Load file if exists] *********************************** Monday 16 March 2026 14:30:36 +0000 (0:00:00.171) 0:00:52.831 ********** skipping: [instance] TASK [libvirt_manager : Update fact with existing content] ********************* Monday 16 March 2026 14:30:36 +0000 (0:00:00.027) 0:00:52.859 ********** skipping: [instance] TASK [libvirt_manager : Generate VM list] ************************************** Monday 16 March 2026 14:30:36 +0000 (0:00:00.058) 0:00:52.918 ********** ok: [instance] TASK [libvirt_manager : Generate/update mapping all nodes] ********************* Monday 16 March 2026 14:30:36 +0000 (0:00:00.048) 0:00:52.966 ********** ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Append baremetal nodes if needed] ********************** Monday 16 March 2026 14:30:36 +0000 (0:00:00.111) 0:00:53.078 ********** skipping: [instance] TASK [libvirt_manager : Dump MAC mapping] ************************************** Monday 16 March 2026 14:30:36 +0000 (0:00:00.033) 0:00:53.111 ********** changed: [instance] TASK [libvirt_manager : Inject all VMs in the inventory] *********************** Monday 16 March 2026 14:30:37 +0000 (0:00:00.316) 0:00:53.428 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) TASK [libvirt_manager : Add host to runtime inventory] ************************* Monday 16 March 2026 14:30:37 +0000 (0:00:00.086) 0:00:53.515 ********** changed: [instance] TASK [libvirt_manager : Ensure group section exists] *************************** Monday 16 March 2026 14:30:37 +0000 (0:00:00.050) 0:00:53.565 ********** changed: [instance] TASK [libvirt_manager : Append host under proper group] ************************ Monday 16 March 2026 14:30:37 +0000 (0:00:00.274) 0:00:53.839 ********** changed: [instance] TASK [libvirt_manager : daniel debug] ****************************************** Monday 16 March 2026 14:30:37 +0000 (0:00:00.204) 0:00:54.044 ********** changed: [instance] TASK [libvirt_manager : Add host to runtime inventory] ************************* Monday 16 March 2026 14:30:37 +0000 (0:00:00.376) 0:00:54.420 ********** changed: [instance] TASK [libvirt_manager : Ensure group section exists] *************************** Monday 16 March 2026 14:30:38 +0000 (0:00:00.051) 0:00:54.472 ********** changed: [instance] TASK [libvirt_manager : Append host under proper group] ************************ Monday 16 March 2026 14:30:38 +0000 (0:00:00.188) 0:00:54.660 ********** changed: [instance] TASK [libvirt_manager : daniel debug] ****************************************** Monday 16 March 2026 14:30:38 +0000 (0:00:00.211) 0:00:54.872 ********** changed: [instance] TASK [libvirt_manager : Add host to runtime inventory] ************************* Monday 16 March 2026 14:30:38 +0000 (0:00:00.364) 0:00:55.237 ********** changed: [instance] TASK [libvirt_manager : Ensure group section exists] *************************** Monday 16 March 2026 14:30:38 +0000 (0:00:00.052) 0:00:55.289 ********** changed: [instance] TASK [libvirt_manager : Append host under proper group] ************************ Monday 16 March 2026 14:30:39 +0000 (0:00:00.193) 0:00:55.482 ********** changed: [instance] TASK [libvirt_manager : daniel debug] ****************************************** Monday 16 March 2026 14:30:39 +0000 (0:00:00.204) 0:00:55.686 ********** changed: [instance] TASK [libvirt_manager : Check if ini inventory file exists] ******************** Monday 16 March 2026 14:30:39 +0000 (0:00:00.354) 0:00:56.041 ********** ok: [instance] TASK [libvirt_manager : checking if ansible-inventory is available] ************ Monday 16 March 2026 14:30:39 +0000 (0:00:00.179) 0:00:56.221 ********** changed: [instance] TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** Monday 16 March 2026 14:30:39 +0000 (0:00:00.176) 0:00:56.398 ********** changed: [instance] TASK [networking_mapper : Check for Networking Definition file existence] ****** Monday 16 March 2026 14:30:40 +0000 (0:00:00.478) 0:00:56.876 ********** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Monday 16 March 2026 14:30:40 +0000 (0:00:00.022) 0:00:56.898 ********** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Monday 16 March 2026 14:30:40 +0000 (0:00:00.020) 0:00:56.919 ********** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Monday 16 March 2026 14:30:40 +0000 (0:00:00.020) 0:00:56.940 ********** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Monday 16 March 2026 14:30:40 +0000 (0:00:00.023) 0:00:56.964 ********** ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Monday 16 March 2026 14:30:40 +0000 (0:00:00.018) 0:00:56.982 ********** ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Monday 16 March 2026 14:30:40 +0000 (0:00:00.078) 0:00:57.061 ********** skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Monday 16 March 2026 14:30:40 +0000 (0:00:00.018) 0:00:57.079 ********** changed: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Monday 16 March 2026 14:30:40 +0000 (0:00:00.191) 0:00:57.270 ********** changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Monday 16 March 2026 14:30:41 +0000 (0:00:00.381) 0:00:57.652 ********** ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Monday 16 March 2026 14:30:41 +0000 (0:00:00.058) 0:00:57.711 ********** ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Monday 16 March 2026 14:30:41 +0000 (0:00:00.030) 0:00:57.741 ********** changed: [instance] TASK [libvirt_manager : Manage networks if needed] ***************************** Monday 16 March 2026 14:30:41 +0000 (0:00:00.359) 0:00:58.100 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** Monday 16 March 2026 14:30:41 +0000 (0:00:00.104) 0:00:58.204 ********** ok: [instance] => (item=public) ok: [instance] => (item=osp_trunk) TASK [libvirt_manager : Ensure networks are defined] *************************** Monday 16 March 2026 14:30:41 +0000 (0:00:00.047) 0:00:58.252 ********** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are created/started] ******************* Monday 16 March 2026 14:30:42 +0000 (0:00:00.408) 0:00:58.661 ********** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks are active] **************************** Monday 16 March 2026 14:30:42 +0000 (0:00:00.551) 0:00:59.213 ********** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** Monday 16 March 2026 14:30:43 +0000 (0:00:00.415) 0:00:59.628 ********** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** Monday 16 March 2026 14:30:43 +0000 (0:00:00.398) 0:01:00.026 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance TASK [libvirt_manager : Fetch present bridge interfaces] *********************** Monday 16 March 2026 14:30:43 +0000 (0:00:00.058) 0:01:00.085 ********** ok: [instance] TASK [libvirt_manager : Fetch bridges ports link info] ************************* Monday 16 March 2026 14:30:43 +0000 (0:00:00.175) 0:01:00.261 ********** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [Create dummy interfaces to ensure bridges are UP] ************************ Monday 16 March 2026 14:30:44 +0000 (0:00:00.356) 0:01:00.617 ********** TASK [ci_nmstate : Ensure we have needed facts] ******************************** Monday 16 March 2026 14:30:44 +0000 (0:00:00.063) 0:01:00.681 ********** skipping: [instance] TASK [ci_nmstate : Install required packages on instance] ********************** Monday 16 March 2026 14:30:44 +0000 (0:00:00.034) 0:01:00.716 ********** ok: [instance] TASK [ci_nmstate : Create the target NMstate dump directory] ******************* Monday 16 March 2026 14:30:45 +0000 (0:00:01.217) 0:01:01.934 ********** ok: [instance] TASK [ci_nmstate : Save nmstate state for instance] **************************** Monday 16 March 2026 14:30:45 +0000 (0:00:00.181) 0:01:02.115 ********** changed: [instance] TASK [ci_nmstate : Apply the desidered state on instance] ********************** Monday 16 March 2026 14:30:46 +0000 (0:00:00.348) 0:01:02.463 ********** changed: [instance] TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* Monday 16 March 2026 14:30:47 +0000 (0:00:01.610) 0:01:04.073 ********** changed: [instance] TASK [Create extra network configuration] ************************************** Monday 16 March 2026 14:30:47 +0000 (0:00:00.336) 0:01:04.410 ********** skipping: [instance] TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** Monday 16 March 2026 14:30:48 +0000 (0:00:00.030) 0:01:04.440 ********** skipping: [instance] TASK [libvirt_manager : Refresh networking facts on host] ********************** Monday 16 March 2026 14:30:48 +0000 (0:00:00.029) 0:01:04.470 ********** ok: [instance] TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** Monday 16 March 2026 14:30:48 +0000 (0:00:00.430) 0:01:04.900 ********** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [dnsmasq : Install needed packages] *************************************** Monday 16 March 2026 14:30:48 +0000 (0:00:00.138) 0:01:05.039 ********** ok: [instance] TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** Monday 16 March 2026 14:30:49 +0000 (0:00:01.184) 0:01:06.224 ********** changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) TASK [dnsmasq : Manage configuration directory] ******************************** Monday 16 March 2026 14:30:53 +0000 (0:00:03.611) 0:01:09.835 ********** changed: [instance] TASK [dnsmasq : Manage systemd unit file] ************************************** Monday 16 March 2026 14:30:53 +0000 (0:00:00.205) 0:01:10.041 ********** changed: [instance] TASK [dnsmasq : Manage base configuration file] ******************************** Monday 16 March 2026 14:30:53 +0000 (0:00:00.365) 0:01:10.406 ********** changed: [instance] TASK [dnsmasq : Render listener configuration] ********************************* Monday 16 March 2026 14:30:54 +0000 (0:00:00.414) 0:01:10.820 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance TASK [dnsmasq : Create listener configuration file] **************************** Monday 16 March 2026 14:30:54 +0000 (0:00:00.031) 0:01:10.852 ********** changed: [instance] TASK [dnsmasq : Remove listener configuration file] **************************** Monday 16 March 2026 14:30:54 +0000 (0:00:00.363) 0:01:11.215 ********** skipping: [instance] TASK [dnsmasq : Render dns configuration] ************************************** Monday 16 March 2026 14:30:54 +0000 (0:00:00.019) 0:01:11.235 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance TASK [dnsmasq : Create dns configuration file] ********************************* Monday 16 March 2026 14:30:54 +0000 (0:00:00.033) 0:01:11.268 ********** changed: [instance] TASK [dnsmasq : Remove dns configuration file] ********************************* Monday 16 March 2026 14:30:55 +0000 (0:00:00.355) 0:01:11.624 ********** skipping: [instance] TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** Monday 16 March 2026 14:30:55 +0000 (0:00:00.021) 0:01:11.646 ********** ok: [instance] => (item=127.0.0.2) TASK [dnsmasq : Enable and start service] ************************************** Monday 16 March 2026 14:30:55 +0000 (0:00:00.205) 0:01:11.851 ********** changed: [instance] TASK [dnsmasq : Stop service] ************************************************** Monday 16 March 2026 14:30:56 +0000 (0:00:00.649) 0:01:12.500 ********** skipping: [instance] TASK [dnsmasq : Remove unit file] ********************************************** Monday 16 March 2026 14:30:56 +0000 (0:00:00.019) 0:01:12.520 ********** skipping: [instance] TASK [dnsmasq : Remove main configuration files] ******************************* Monday 16 March 2026 14:30:56 +0000 (0:00:00.019) 0:01:12.539 ********** skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) skipping: [instance] TASK [Create dnsmasq networks] ************************************************* Monday 16 March 2026 14:30:56 +0000 (0:00:00.030) 0:01:12.570 ********** TASK [dnsmasq : Assert mandatory parameter] ************************************ Monday 16 March 2026 14:30:56 +0000 (0:00:00.117) 0:01:12.687 ********** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Monday 16 March 2026 14:30:56 +0000 (0:00:00.030) 0:01:12.717 ********** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Monday 16 March 2026 14:30:56 +0000 (0:00:00.037) 0:01:12.755 ********** changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Monday 16 March 2026 14:30:56 +0000 (0:00:00.419) 0:01:13.174 ********** skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Monday 16 March 2026 14:30:56 +0000 (0:00:00.018) 0:01:13.193 ********** skipping: [instance] TASK [dnsmasq : Assert mandatory parameter] ************************************ Monday 16 March 2026 14:30:56 +0000 (0:00:00.024) 0:01:13.218 ********** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Assert mandatory parameters for new network] ******************* Monday 16 March 2026 14:30:56 +0000 (0:00:00.029) 0:01:13.247 ********** ok: [instance] => changed=false msg: All assertions passed TASK [dnsmasq : Create network] ************************************************ Monday 16 March 2026 14:30:56 +0000 (0:00:00.036) 0:01:13.284 ********** changed: [instance] TASK [dnsmasq : Remove network] ************************************************ Monday 16 March 2026 14:30:57 +0000 (0:00:00.423) 0:01:13.707 ********** skipping: [instance] TASK [dnsmasq : Remove dhcp host files] **************************************** Monday 16 March 2026 14:30:57 +0000 (0:00:00.019) 0:01:13.726 ********** skipping: [instance] TASK [Deploy radvd for IPv6 router advertisements] ***************************** Monday 16 March 2026 14:30:57 +0000 (0:00:00.023) 0:01:13.750 ********** skipping: [instance] TASK [libvirt_manager : Ensure network is in correct zone] ********************* Monday 16 March 2026 14:30:57 +0000 (0:00:00.030) 0:01:13.781 ********** changed: [instance] => (item=cifmw-public) changed: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Monday 16 March 2026 14:30:57 +0000 (0:00:00.473) 0:01:14.255 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) TASK [libvirt_manager : Extract IP address from network bridges] *************** Monday 16 March 2026 14:30:57 +0000 (0:00:00.036) 0:01:14.292 ********** ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Monday 16 March 2026 14:30:58 +0000 (0:00:00.320) 0:01:14.613 ********** ok: [instance] TASK [libvirt_manager : Extract IP address from network bridges] *************** Monday 16 March 2026 14:30:58 +0000 (0:00:00.036) 0:01:14.649 ********** ok: [instance] TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** Monday 16 March 2026 14:30:58 +0000 (0:00:00.196) 0:01:14.845 ********** ok: [instance] TASK [libvirt_manager : Output _network_data] ********************************** Monday 16 March 2026 14:30:58 +0000 (0:00:00.034) 0:01:14.879 ********** changed: [instance] TASK [libvirt_manager : Output pub_net] **************************************** Monday 16 March 2026 14:30:58 +0000 (0:00:00.333) 0:01:15.213 ********** changed: [instance] TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** Monday 16 March 2026 14:30:59 +0000 (0:00:00.318) 0:01:15.532 ********** changed: [instance] TASK [libvirt_manager : Expose patch for networking_mapper] ******************** Monday 16 March 2026 14:30:59 +0000 (0:00:00.329) 0:01:15.861 ********** ok: [instance] TASK [libvirt_manager : Save networking_mapper patch] ************************** Monday 16 March 2026 14:30:59 +0000 (0:00:00.088) 0:01:15.950 ********** changed: [instance] TASK [networking_mapper : Check for Networking Definition file existence] ****** Monday 16 March 2026 14:30:59 +0000 (0:00:00.324) 0:01:16.275 ********** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Monday 16 March 2026 14:30:59 +0000 (0:00:00.024) 0:01:16.300 ********** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Monday 16 March 2026 14:30:59 +0000 (0:00:00.021) 0:01:16.321 ********** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Monday 16 March 2026 14:30:59 +0000 (0:00:00.021) 0:01:16.343 ********** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Monday 16 March 2026 14:30:59 +0000 (0:00:00.022) 0:01:16.365 ********** ok: [instance] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Monday 16 March 2026 14:30:59 +0000 (0:00:00.019) 0:01:16.385 ********** ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) TASK [networking_mapper : Gather facts if requested] *************************** Monday 16 March 2026 14:31:00 +0000 (0:00:00.118) 0:01:16.503 ********** skipping: [instance] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Monday 16 March 2026 14:31:00 +0000 (0:00:00.018) 0:01:16.521 ********** ok: [instance] TASK [networking_mapper : Write the Networking Definition to file] ************* Monday 16 March 2026 14:31:00 +0000 (0:00:00.189) 0:01:16.711 ********** changed: [instance] TASK [networking_mapper : Call the networking mapper] ************************** Monday 16 March 2026 14:31:00 +0000 (0:00:00.376) 0:01:17.087 ********** ok: [instance] TASK [networking_mapper : Set networking mapper facts] ************************* Monday 16 March 2026 14:31:00 +0000 (0:00:00.060) 0:01:17.148 ********** ok: [instance] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Monday 16 March 2026 14:31:00 +0000 (0:00:00.030) 0:01:17.179 ********** changed: [instance] TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** Monday 16 March 2026 14:31:01 +0000 (0:00:00.417) 0:01:17.596 ********** ok: [instance] TASK [libvirt_manager : Unset patch] ******************************************* Monday 16 March 2026 14:31:01 +0000 (0:00:00.028) 0:01:17.624 ********** ok: [instance] TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** Monday 16 March 2026 14:31:01 +0000 (0:00:00.019) 0:01:17.643 ********** ok: [instance] TASK [libvirt_manager : Reserve IPs on networks] ******************************* Monday 16 March 2026 14:31:01 +0000 (0:00:00.020) 0:01:17.663 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 16 March 2026 14:31:01 +0000 (0:00:00.072) 0:01:17.736 ********** ok: [instance] => (item=compute-0 - ctlplane) ok: [instance] => (item=controller-0 - ctlplane) ok: [instance] => (item=crc-0 - ctlplane) TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 16 March 2026 14:31:01 +0000 (0:00:00.131) 0:01:17.867 ********** skipping: [instance] => (item=compute-0 - internalapi) skipping: [instance] => (item=controller-0 - internalapi) skipping: [instance] => (item=crc-0 - internalapi) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 16 March 2026 14:31:01 +0000 (0:00:00.082) 0:01:17.950 ********** skipping: [instance] => (item=compute-0 - storage) skipping: [instance] => (item=controller-0 - storage) skipping: [instance] => (item=crc-0 - storage) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 16 March 2026 14:31:01 +0000 (0:00:00.076) 0:01:18.027 ********** skipping: [instance] => (item=compute-0 - tenant) skipping: [instance] => (item=controller-0 - tenant) skipping: [instance] => (item=crc-0 - tenant) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 16 March 2026 14:31:01 +0000 (0:00:00.079) 0:01:18.106 ********** skipping: [instance] => (item=compute-0 - external) skipping: [instance] => (item=controller-0 - external) skipping: [instance] => (item=crc-0 - external) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 16 March 2026 14:31:01 +0000 (0:00:00.080) 0:01:18.186 ********** skipping: [instance] => (item=compute-0 - storagemgmt) skipping: [instance] => (item=controller-0 - storagemgmt) skipping: [instance] => (item=crc-0 - storagemgmt) skipping: [instance] TASK [libvirt_manager : Loop on host IPs] ************************************** Monday 16 March 2026 14:31:01 +0000 (0:00:00.078) 0:01:18.265 ********** ok: [instance] => (item=compute-0 - public) ok: [instance] => (item=controller-0 - public) ok: [instance] => (item=crc-0 - public) TASK [Inject DHCP entries for net {{ net_name }}] ****************************** Monday 16 March 2026 14:31:01 +0000 (0:00:00.133) 0:01:18.399 ********** TASK [dnsmasq : Ensure we have the right data and type] ************************ Monday 16 March 2026 14:31:02 +0000 (0:00:00.105) 0:01:18.504 ********** ok: [instance] TASK [dnsmasq : Assert we have needed host data] ******************************* Monday 16 March 2026 14:31:02 +0000 (0:00:00.037) 0:01:18.542 ********** ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ba:3e:9c', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:aa:23:ce', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:e2:02:77', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:1e:1d:c5', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:70:3b:a3', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:26:05:5f', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) TASK [dnsmasq : Ensure networks exists] **************************************** Monday 16 March 2026 14:31:02 +0000 (0:00:00.096) 0:01:18.638 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) TASK [dnsmasq : Check network file status] ************************************* Monday 16 March 2026 14:31:02 +0000 (0:00:00.052) 0:01:18.690 ********** ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Monday 16 March 2026 14:31:02 +0000 (0:00:00.173) 0:01:18.863 ********** ok: [instance] TASK [dnsmasq : Check network file status] ************************************* Monday 16 March 2026 14:31:02 +0000 (0:00:00.023) 0:01:18.887 ********** ok: [instance] TASK [dnsmasq : Assert network exists] ***************************************** Monday 16 March 2026 14:31:02 +0000 (0:00:00.169) 0:01:19.057 ********** ok: [instance] TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** Monday 16 March 2026 14:31:02 +0000 (0:00:00.023) 0:01:19.080 ********** ok: [instance] TASK [dnsmasq : Compute entry] ************************************************* Monday 16 March 2026 14:31:02 +0000 (0:00:00.019) 0:01:19.099 ********** ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ba:3e:9c', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:aa:23:ce', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:e2:02:77', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:1e:1d:c5', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:70:3b:a3', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:26:05:5f', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) TASK [dnsmasq : Create add/remove sets] **************************************** Monday 16 March 2026 14:31:02 +0000 (0:00:00.169) 0:01:19.268 ********** ok: [instance] TASK [dnsmasq : Add DHCP entries] ********************************************** Monday 16 March 2026 14:31:02 +0000 (0:00:00.036) 0:01:19.305 ********** changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:ba:3e:9c', 'entry': 'set:compute,52:54:00:ba:3e:9c,192.168.140.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:aa:23:ce', 'entry': 'set:controller,52:54:01:aa:23:ce,192.168.140.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:e2:02:77', 'entry': 'set:ocp,52:54:02:e2:02:77,192.168.140.10,crc-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_compute-0_52:54:00:1e:1d:c5', 'entry': 'set:compute,52:54:00:1e:1d:c5,192.168.101.100,compute-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_controller-0_52:54:01:70:3b:a3', 'entry': 'set:controller,52:54:01:70:3b:a3,192.168.101.9,controller-0', 'state': 'present'}) changed: [instance] => (item={'file': 'public_crc-0_52:54:02:26:05:5f', 'entry': 'set:ocp,52:54:02:26:05:5f,192.168.101.10,crc-0', 'state': 'present'}) TASK [dnsmasq : Remove DHCP entries] ******************************************* Monday 16 March 2026 14:31:04 +0000 (0:00:01.950) 0:01:21.256 ********** skipping: [instance] TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** Monday 16 March 2026 14:31:04 +0000 (0:00:00.023) 0:01:21.279 ********** ok: [instance] => (item=compute-0) ok: [instance] => (item=controller-0) ok: [instance] => (item=crc-0) TASK [Inject VMs in the .utility zone] ***************************************** Monday 16 March 2026 14:31:05 +0000 (0:00:00.206) 0:01:21.486 ********** TASK [dnsmasq : Assert we have needed host record data] ************************ Monday 16 March 2026 14:31:05 +0000 (0:00:00.113) 0:01:21.600 ********** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Monday 16 March 2026 14:31:05 +0000 (0:00:00.042) 0:01:21.642 ********** ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Monday 16 March 2026 14:31:05 +0000 (0:00:00.219) 0:01:21.861 ********** changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** Monday 16 March 2026 14:31:08 +0000 (0:00:02.965) 0:01:24.827 ********** skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) TASK [dnsmasq : Remove crc.testing from host_records] ************************** Monday 16 March 2026 14:31:08 +0000 (0:00:00.327) 0:01:25.154 ********** skipping: [instance] TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** Monday 16 March 2026 14:31:08 +0000 (0:00:00.036) 0:01:25.190 ********** ok: [instance] TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** Monday 16 March 2026 14:31:08 +0000 (0:00:00.019) 0:01:25.210 ********** skipping: [instance] => (item=compute) skipping: [instance] => (item=controller) skipping: [instance] => (item=crc) skipping: [instance] TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* Monday 16 March 2026 14:31:08 +0000 (0:00:00.045) 0:01:25.255 ********** skipping: [instance] TASK [libvirt_manager : Ensure some domains are local] ************************* Monday 16 March 2026 14:31:08 +0000 (0:00:00.032) 0:01:25.288 ********** changed: [instance] TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ Monday 16 March 2026 14:31:09 +0000 (0:00:00.348) 0:01:25.636 ********** RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Monday 16 March 2026 14:31:09 +0000 (0:00:00.011) 0:01:25.647 ********** changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Monday 16 March 2026 14:31:09 +0000 (0:00:00.608) 0:01:26.256 ********** changed: [instance] RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* Monday 16 March 2026 14:31:10 +0000 (0:00:00.352) 0:01:26.609 ********** changed: [instance] TASK [reproducer : Delegate our domains to our own instance] ******************* Monday 16 March 2026 14:31:10 +0000 (0:00:00.338) 0:01:26.947 ********** changed: [instance] TASK [reproducer : Ensure "utility" domain is local] *************************** Monday 16 March 2026 14:31:10 +0000 (0:00:00.357) 0:01:27.305 ********** changed: [instance] TASK [Build utility records dataset] ******************************************* Monday 16 March 2026 14:31:11 +0000 (0:00:00.360) 0:01:27.665 ********** TASK [dnsmasq : Assert we have needed host record data] ************************ Monday 16 March 2026 14:31:11 +0000 (0:00:00.037) 0:01:27.703 ********** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Monday 16 March 2026 14:31:11 +0000 (0:00:00.090) 0:01:27.793 ********** ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Monday 16 March 2026 14:31:11 +0000 (0:00:00.094) 0:01:27.888 ********** changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** Monday 16 March 2026 14:31:11 +0000 (0:00:00.450) 0:01:28.338 ********** skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) TASK [dnsmasq : Remove crc.testing from host_records] ************************** Monday 16 March 2026 14:31:12 +0000 (0:00:00.271) 0:01:28.610 ********** skipping: [instance] TASK [reproducer : Flush handlers] ********************************************* Monday 16 March 2026 14:31:12 +0000 (0:00:00.037) 0:01:28.648 ********** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Monday 16 March 2026 14:31:12 +0000 (0:00:00.010) 0:01:28.658 ********** changed: [instance] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Monday 16 March 2026 14:31:12 +0000 (0:00:00.456) 0:01:29.115 ********** changed: [instance] TASK [reproducer : Bootstrap nat64 if needed] ********************************** Monday 16 March 2026 14:31:13 +0000 (0:00:00.342) 0:01:29.457 ********** skipping: [instance] TASK [reproducer : Deploy CRC if needed] *************************************** Monday 16 March 2026 14:31:13 +0000 (0:00:00.032) 0:01:29.489 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance TASK [reproducer : Check for CRC availability in known path] ******************* Monday 16 March 2026 14:31:13 +0000 (0:00:00.076) 0:01:29.566 ********** ok: [instance] TASK [Deploy CRC if needed] **************************************************** Monday 16 March 2026 14:31:13 +0000 (0:00:00.212) 0:01:29.779 ********** skipping: [instance] TASK [rhol_crc : Stop CRC VM] ************************************************** Monday 16 March 2026 14:31:13 +0000 (0:00:00.030) 0:01:29.809 ********** ok: [instance] TASK [rhol_crc : Undefine CRC VM] ********************************************** Monday 16 March 2026 14:31:13 +0000 (0:00:00.318) 0:01:30.127 ********** ok: [instance] TASK [rhol_crc : Destroy CRC network] ****************************************** Monday 16 March 2026 14:31:13 +0000 (0:00:00.225) 0:01:30.353 ********** ok: [instance] TASK [rhol_crc : Undefine CRC network] ***************************************** Monday 16 March 2026 14:31:14 +0000 (0:00:00.210) 0:01:30.564 ********** ok: [instance] TASK [rhol_crc : Destroy default network] ************************************** Monday 16 March 2026 14:31:14 +0000 (0:00:00.211) 0:01:30.775 ********** ok: [instance] TASK [Check if new ssh keypair exists] ***************************************** Monday 16 March 2026 14:31:14 +0000 (0:00:00.221) 0:01:30.996 ********** TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Monday 16 March 2026 14:31:14 +0000 (0:00:00.040) 0:01:31.036 ********** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Monday 16 March 2026 14:31:14 +0000 (0:00:00.189) 0:01:31.225 ********** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Monday 16 March 2026 14:31:14 +0000 (0:00:00.023) 0:01:31.249 ********** skipping: [instance] TASK [reproducer : Slurp ssh key for CRC access] ******************************* Monday 16 March 2026 14:31:14 +0000 (0:00:00.027) 0:01:31.276 ********** ok: [instance] TASK [reproducer : Get kubeconfig file from crc directory] ********************* Monday 16 March 2026 14:31:15 +0000 (0:00:00.276) 0:01:31.552 ********** ok: [instance] TASK [reproducer : Get kubeadmin-password file from crc directory] ************* Monday 16 March 2026 14:31:15 +0000 (0:00:00.215) 0:01:31.768 ********** ok: [instance] TASK [Ensure we expose openshift_login related facts] ************************** Monday 16 March 2026 14:31:15 +0000 (0:00:00.166) 0:01:31.935 ********** TASK [openshift_login : Assert we have needed parameters] ********************** Monday 16 March 2026 14:31:15 +0000 (0:00:00.056) 0:01:31.991 ********** ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Stat kubeconfig] *************************************** Monday 16 March 2026 14:31:15 +0000 (0:00:00.043) 0:01:32.034 ********** ok: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Monday 16 March 2026 14:31:15 +0000 (0:00:00.171) 0:01:32.206 ********** ok: [instance] TASK [openshift_login : Assert files exist] ************************************ Monday 16 March 2026 14:31:15 +0000 (0:00:00.181) 0:01:32.388 ********** ok: [instance] => changed=false msg: All assertions passed TASK [openshift_login : Gather the password of the deployed cluster.] ********** Monday 16 March 2026 14:31:15 +0000 (0:00:00.024) 0:01:32.412 ********** ok: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Monday 16 March 2026 14:31:16 +0000 (0:00:00.181) 0:01:32.593 ********** ok: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Monday 16 March 2026 14:31:16 +0000 (0:00:00.172) 0:01:32.765 ********** ok: [instance] TASK [reproducer : Remove CRC managed zone delegation] ************************* Monday 16 March 2026 14:31:16 +0000 (0:00:00.048) 0:01:32.814 ********** changed: [instance] => (item=dnsmasq.d/crc.conf) changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ Monday 16 March 2026 14:31:16 +0000 (0:00:00.363) 0:01:33.177 ********** skipping: [instance] TASK [Load the architecture local kustomize patches] *************************** Monday 16 March 2026 14:31:16 +0000 (0:00:00.018) 0:01:33.196 ********** skipping: [instance] TASK [reproducer : Consume libvirt_manager] ************************************ Monday 16 March 2026 14:31:16 +0000 (0:00:00.023) 0:01:33.219 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance TASK [libvirt_manager : Import layout generator if needed] ********************* Monday 16 March 2026 14:31:16 +0000 (0:00:00.122) 0:01:33.341 ********** skipping: [instance] TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** Monday 16 March 2026 14:31:16 +0000 (0:00:00.022) 0:01:33.364 ********** changed: [instance] TASK [libvirt_manager : Enable masquerading for public traffic] **************** Monday 16 March 2026 14:31:17 +0000 (0:00:00.389) 0:01:33.753 ********** changed: [instance] TASK [libvirt_manager : Ensure firewalld is restarts] ************************** Monday 16 March 2026 14:31:17 +0000 (0:00:00.482) 0:01:34.236 ********** RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** Monday 16 March 2026 14:31:17 +0000 (0:00:00.010) 0:01:34.247 ********** changed: [instance] RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** Monday 16 March 2026 14:31:18 +0000 (0:00:00.427) 0:01:34.674 ********** changed: [instance] TASK [Deploy virtualbmc] ******************************************************* Monday 16 March 2026 14:31:18 +0000 (0:00:00.630) 0:01:35.304 ********** skipping: [instance] TASK [libvirt_manager : Let the project know we have vbmc available] *********** Monday 16 March 2026 14:31:18 +0000 (0:00:00.031) 0:01:35.335 ********** skipping: [instance] TASK [libvirt_manager : Create needed workload directory] ********************** Monday 16 March 2026 14:31:18 +0000 (0:00:00.031) 0:01:35.366 ********** changed: [instance] => (item=workload) changed: [instance] => (item=reproducer-inventory) ok: [instance] => (item=volumes) TASK [libvirt_manager : Allow QEMU on workload directory] ********************** Monday 16 March 2026 14:31:19 +0000 (0:00:00.510) 0:01:35.877 ********** changed: [instance] => (item=workload) changed: [instance] => (item=volumes) TASK [libvirt_manager : Generate networking data] ****************************** Monday 16 March 2026 14:31:19 +0000 (0:00:00.379) 0:01:36.256 ********** skipping: [instance] TASK [libvirt_manager : Create group inventories] ****************************** Monday 16 March 2026 14:31:19 +0000 (0:00:00.025) 0:01:36.282 ********** changed: [instance] => (item=compute) changed: [instance] => (item=controller) changed: [instance] => (item=crc) TASK [libvirt_manager : Create "all" group inventory file] ********************* Monday 16 March 2026 14:31:20 +0000 (0:00:00.962) 0:01:37.244 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance TASK [libvirt_manager : Check if all-group.yml already exists] ***************** Monday 16 March 2026 14:31:20 +0000 (0:00:00.030) 0:01:37.275 ********** ok: [instance] TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* Monday 16 March 2026 14:31:21 +0000 (0:00:00.172) 0:01:37.448 ********** skipping: [instance] TASK [libvirt_manager : Create new "all" group inventory file from template] *** Monday 16 March 2026 14:31:21 +0000 (0:00:00.019) 0:01:37.467 ********** changed: [instance] TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* Monday 16 March 2026 14:31:21 +0000 (0:00:00.359) 0:01:37.827 ********** skipping: [instance] TASK [libvirt_manager : Write merged all-group.yml] **************************** Monday 16 March 2026 14:31:21 +0000 (0:00:00.020) 0:01:37.847 ********** skipping: [instance] TASK [libvirt_manager : Ensure storage pool is present.] *********************** Monday 16 March 2026 14:31:21 +0000 (0:00:00.019) 0:01:37.867 ********** skipping: [instance] TASK [libvirt_manager : Ensure images are present] ***************************** Monday 16 March 2026 14:31:21 +0000 (0:00:00.038) 0:01:37.906 ********** skipping: [instance] => (item=crc) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) TASK [libvirt_manager : Ensure directory exists] ******************************* Monday 16 March 2026 14:31:21 +0000 (0:00:00.065) 0:01:37.972 ********** changed: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Monday 16 March 2026 14:31:21 +0000 (0:00:00.201) 0:01:38.174 ********** ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Monday 16 March 2026 14:31:21 +0000 (0:00:00.173) 0:01:38.348 ********** changed: [instance] TASK [libvirt_manager : Check image] ******************************************* Monday 16 March 2026 14:31:53 +0000 (0:00:31.307) 0:02:09.656 ********** ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Monday 16 March 2026 14:31:53 +0000 (0:00:00.186) 0:02:09.842 ********** ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Monday 16 March 2026 14:31:53 +0000 (0:00:00.040) 0:02:09.882 ********** changed: [instance] TASK [libvirt_manager : Ensure directory exists] ******************************* Monday 16 March 2026 14:31:53 +0000 (0:00:00.200) 0:02:10.083 ********** ok: [instance] TASK [libvirt_manager : Check if base image exists] **************************** Monday 16 March 2026 14:31:53 +0000 (0:00:00.205) 0:02:10.289 ********** ok: [instance] TASK [libvirt_manager : Download base image] *********************************** Monday 16 March 2026 14:31:54 +0000 (0:00:00.195) 0:02:10.484 ********** skipping: [instance] TASK [libvirt_manager : Check image] ******************************************* Monday 16 March 2026 14:31:54 +0000 (0:00:00.023) 0:02:10.507 ********** ok: [instance] TASK [libvirt_manager : Assert image status] *********************************** Monday 16 March 2026 14:31:54 +0000 (0:00:00.201) 0:02:10.709 ********** ok: [instance] => changed=false msg: All assertions passed TASK [libvirt_manager : Ensure image access rights] **************************** Monday 16 March 2026 14:31:54 +0000 (0:00:00.039) 0:02:10.748 ********** ok: [instance] TASK [libvirt_manager : Get ssh key state] ************************************* Monday 16 March 2026 14:31:54 +0000 (0:00:00.202) 0:02:10.950 ********** ok: [instance] TASK [libvirt_manager : Create temporary ssh keypair] ************************** Monday 16 March 2026 14:31:54 +0000 (0:00:00.166) 0:02:11.117 ********** changed: [instance] TASK [libvirt_manager : Slurp public key for later use] ************************ Monday 16 March 2026 14:31:55 +0000 (0:00:00.369) 0:02:11.487 ********** ok: [instance] TASK [libvirt_manager : Slurp private key for later use] *********************** Monday 16 March 2026 14:31:55 +0000 (0:00:00.165) 0:02:11.652 ********** ok: [instance] TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** Monday 16 March 2026 14:31:55 +0000 (0:00:00.163) 0:02:11.815 ********** changed: [instance] TASK [libvirt_manager : Create fact holding network data for VMs] ************** Monday 16 March 2026 14:31:55 +0000 (0:00:00.375) 0:02:12.191 ********** ok: [instance] TASK [libvirt_manager : List existing networks] ******************************** Monday 16 March 2026 14:31:55 +0000 (0:00:00.019) 0:02:12.210 ********** ok: [instance] TASK [libvirt_manager : Gather pool fact] ************************************** Monday 16 March 2026 14:31:56 +0000 (0:00:00.211) 0:02:12.422 ********** ok: [instance] TASK [libvirt_manager : Create and run VMs] ************************************ Monday 16 March 2026 14:31:56 +0000 (0:00:00.444) 0:02:12.866 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Create VM image for compute-0] ************************* Monday 16 March 2026 14:31:56 +0000 (0:00:00.118) 0:02:12.984 ********** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** Monday 16 March 2026 14:31:56 +0000 (0:00:00.238) 0:02:13.223 ********** changed: [instance] TASK [libvirt_manager : Define VMs for type compute-0] ************************* Monday 16 March 2026 14:31:57 +0000 (0:00:00.211) 0:02:13.434 ********** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** Monday 16 March 2026 14:31:57 +0000 (0:00:00.310) 0:02:13.744 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Monday 16 March 2026 14:31:57 +0000 (0:00:00.028) 0:02:13.773 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Monday 16 March 2026 14:31:57 +0000 (0:00:00.043) 0:02:13.816 ********** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 16 March 2026 14:31:57 +0000 (0:00:00.216) 0:02:14.032 ********** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 16 March 2026 14:31:57 +0000 (0:00:00.043) 0:02:14.076 ********** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 16 March 2026 14:31:57 +0000 (0:00:00.220) 0:02:14.296 ********** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ Monday 16 March 2026 14:31:58 +0000 (0:00:00.188) 0:02:14.484 ********** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Monday 16 March 2026 14:31:58 +0000 (0:00:00.267) 0:02:14.752 ********** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 16 March 2026 14:31:58 +0000 (0:00:00.232) 0:02:14.984 ********** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 16 March 2026 14:31:58 +0000 (0:00:00.043) 0:02:15.028 ********** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 16 March 2026 14:31:58 +0000 (0:00:00.223) 0:02:15.251 ********** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* Monday 16 March 2026 14:31:59 +0000 (0:00:00.197) 0:02:15.448 ********** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** Monday 16 March 2026 14:31:59 +0000 (0:00:00.275) 0:02:15.724 ********** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** Monday 16 March 2026 14:31:59 +0000 (0:00:00.020) 0:02:15.744 ********** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** Monday 16 March 2026 14:31:59 +0000 (0:00:00.025) 0:02:15.769 ********** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** Monday 16 March 2026 14:31:59 +0000 (0:00:00.027) 0:02:15.797 ********** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Monday 16 March 2026 14:31:59 +0000 (0:00:00.023) 0:02:15.821 ********** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Monday 16 March 2026 14:31:59 +0000 (0:00:00.203) 0:02:16.025 ********** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Monday 16 March 2026 14:31:59 +0000 (0:00:00.038) 0:02:16.064 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Monday 16 March 2026 14:31:59 +0000 (0:00:00.054) 0:02:16.118 ********** ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Monday 16 March 2026 14:31:59 +0000 (0:00:00.191) 0:02:16.310 ********** ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Monday 16 March 2026 14:31:59 +0000 (0:00:00.062) 0:02:16.372 ********** ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Monday 16 March 2026 14:31:59 +0000 (0:00:00.045) 0:02:16.418 ********** skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Monday 16 March 2026 14:32:00 +0000 (0:00:00.042) 0:02:16.461 ********** skipping: [instance] TASK [Call the config_drive role] ********************************************** Monday 16 March 2026 14:32:00 +0000 (0:00:00.042) 0:02:16.503 ********** TASK [config_drive : Ensure needed directories exist] ************************** Monday 16 March 2026 14:32:00 +0000 (0:00:00.060) 0:02:16.563 ********** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Monday 16 March 2026 14:32:00 +0000 (0:00:00.391) 0:02:16.955 ********** ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Monday 16 March 2026 14:32:01 +0000 (0:00:01.219) 0:02:18.174 ********** changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Monday 16 March 2026 14:32:01 +0000 (0:00:00.205) 0:02:18.380 ********** changed: [instance] TASK [config_drive : Generate user-data] *************************************** Monday 16 March 2026 14:32:02 +0000 (0:00:00.345) 0:02:18.726 ********** changed: [instance] TASK [config_drive : Generate network-data] ************************************ Monday 16 March 2026 14:32:02 +0000 (0:00:00.356) 0:02:19.082 ********** skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Monday 16 March 2026 14:32:02 +0000 (0:00:00.043) 0:02:19.126 ********** ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Monday 16 March 2026 14:32:02 +0000 (0:00:00.190) 0:02:19.317 ********** skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Monday 16 March 2026 14:32:02 +0000 (0:00:00.042) 0:02:19.359 ********** Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Monday 16 March 2026 14:32:03 +0000 (0:00:00.233) 0:02:19.593 ********** changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Monday 16 March 2026 14:32:03 +0000 (0:00:00.265) 0:02:19.859 ********** skipping: [instance] TASK [libvirt_manager : Configure boot order for compute-0] ******************** Monday 16 March 2026 14:32:03 +0000 (0:00:00.044) 0:02:19.903 ********** skipping: [instance] TASK [libvirt_manager : Create VM image for controller-0] ********************** Monday 16 March 2026 14:32:03 +0000 (0:00:00.027) 0:02:19.930 ********** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** Monday 16 March 2026 14:32:03 +0000 (0:00:00.232) 0:02:20.163 ********** changed: [instance] TASK [libvirt_manager : Define VMs for type controller-0] ********************** Monday 16 March 2026 14:32:03 +0000 (0:00:00.213) 0:02:20.377 ********** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** Monday 16 March 2026 14:32:04 +0000 (0:00:00.277) 0:02:20.654 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Monday 16 March 2026 14:32:04 +0000 (0:00:00.028) 0:02:20.683 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Monday 16 March 2026 14:32:04 +0000 (0:00:00.042) 0:02:20.725 ********** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 16 March 2026 14:32:04 +0000 (0:00:00.217) 0:02:20.943 ********** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 16 March 2026 14:32:04 +0000 (0:00:00.044) 0:02:20.987 ********** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 16 March 2026 14:32:04 +0000 (0:00:00.222) 0:02:21.210 ********** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* Monday 16 March 2026 14:32:04 +0000 (0:00:00.190) 0:02:21.400 ********** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Monday 16 March 2026 14:32:05 +0000 (0:00:00.275) 0:02:21.676 ********** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 16 March 2026 14:32:05 +0000 (0:00:00.220) 0:02:21.897 ********** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 16 March 2026 14:32:05 +0000 (0:00:00.044) 0:02:21.941 ********** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 16 March 2026 14:32:05 +0000 (0:00:00.225) 0:02:22.167 ********** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** Monday 16 March 2026 14:32:05 +0000 (0:00:00.195) 0:02:22.362 ********** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** Monday 16 March 2026 14:32:06 +0000 (0:00:00.305) 0:02:22.668 ********** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** Monday 16 March 2026 14:32:06 +0000 (0:00:00.021) 0:02:22.689 ********** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** Monday 16 March 2026 14:32:06 +0000 (0:00:00.073) 0:02:22.763 ********** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** Monday 16 March 2026 14:32:06 +0000 (0:00:00.026) 0:02:22.789 ********** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Monday 16 March 2026 14:32:06 +0000 (0:00:00.024) 0:02:22.813 ********** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Monday 16 March 2026 14:32:06 +0000 (0:00:00.205) 0:02:23.018 ********** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Monday 16 March 2026 14:32:06 +0000 (0:00:00.037) 0:02:23.056 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** Monday 16 March 2026 14:32:06 +0000 (0:00:00.050) 0:02:23.106 ********** ok: [instance] TASK [libvirt_manager : Define the default users for the vm] ******************* Monday 16 March 2026 14:32:06 +0000 (0:00:00.187) 0:02:23.293 ********** ok: [instance] TASK [libvirt_manager : Define the user data] ********************************** Monday 16 March 2026 14:32:06 +0000 (0:00:00.059) 0:02:23.353 ********** ok: [instance] TASK [libvirt_manager : Define the network config for all vms] ***************** Monday 16 March 2026 14:32:06 +0000 (0:00:00.044) 0:02:23.397 ********** skipping: [instance] TASK [libvirt_manager : Define the network config for each vm] ***************** Monday 16 March 2026 14:32:07 +0000 (0:00:00.041) 0:02:23.439 ********** skipping: [instance] TASK [Call the config_drive role] ********************************************** Monday 16 March 2026 14:32:07 +0000 (0:00:00.040) 0:02:23.479 ********** TASK [config_drive : Ensure needed directories exist] ************************** Monday 16 March 2026 14:32:07 +0000 (0:00:00.057) 0:02:23.537 ********** ok: [instance] => (item=artifacts) ok: [instance] => (item=logs) TASK [config_drive : Install required RPM packages] **************************** Monday 16 March 2026 14:32:07 +0000 (0:00:00.382) 0:02:23.919 ********** ok: [instance] TASK [config_drive : Crate config drive instance directory] ******************** Monday 16 March 2026 14:32:08 +0000 (0:00:01.204) 0:02:25.123 ********** changed: [instance] TASK [config_drive : Generate meta-data] *************************************** Monday 16 March 2026 14:32:08 +0000 (0:00:00.208) 0:02:25.331 ********** changed: [instance] TASK [config_drive : Generate user-data] *************************************** Monday 16 March 2026 14:32:09 +0000 (0:00:00.346) 0:02:25.678 ********** changed: [instance] TASK [config_drive : Generate network-data] ************************************ Monday 16 March 2026 14:32:09 +0000 (0:00:00.356) 0:02:26.034 ********** skipping: [instance] TASK [config_drive : Check ISO availability] *********************************** Monday 16 March 2026 14:32:09 +0000 (0:00:00.044) 0:02:26.078 ********** ok: [instance] TASK [config_drive : Assert we don't try to change an existing ISO] ************ Monday 16 March 2026 14:32:09 +0000 (0:00:00.188) 0:02:26.267 ********** skipping: [instance] TASK [config_drive : Generate nocloud iso image] ******************************* Monday 16 March 2026 14:32:09 +0000 (0:00:00.040) 0:02:26.307 ********** Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log changed: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Monday 16 March 2026 14:32:10 +0000 (0:00:00.230) 0:02:26.537 ********** changed: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Monday 16 March 2026 14:32:10 +0000 (0:00:00.262) 0:02:26.800 ********** skipping: [instance] TASK [libvirt_manager : Configure boot order for controller-0] ***************** Monday 16 March 2026 14:32:10 +0000 (0:00:00.045) 0:02:26.845 ********** skipping: [instance] TASK [libvirt_manager : Create VM image for crc-0] ***************************** Monday 16 March 2026 14:32:10 +0000 (0:00:00.027) 0:02:26.873 ********** changed: [instance] TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ Monday 16 March 2026 14:32:10 +0000 (0:00:00.236) 0:02:27.110 ********** changed: [instance] TASK [libvirt_manager : Define VMs for type crc-0] ***************************** Monday 16 March 2026 14:32:10 +0000 (0:00:00.216) 0:02:27.326 ********** changed: [instance] TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** Monday 16 March 2026 14:32:11 +0000 (0:00:00.275) 0:02:27.601 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** Monday 16 March 2026 14:32:11 +0000 (0:00:00.028) 0:02:27.629 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) TASK [libvirt_manager : Get virtual network information] *********************** Monday 16 March 2026 14:32:11 +0000 (0:00:00.043) 0:02:27.673 ********** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 16 March 2026 14:32:11 +0000 (0:00:00.218) 0:02:27.892 ********** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 16 March 2026 14:32:11 +0000 (0:00:00.044) 0:02:27.937 ********** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 16 March 2026 14:32:11 +0000 (0:00:00.212) 0:02:28.149 ********** ok: [instance] TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** Monday 16 March 2026 14:32:11 +0000 (0:00:00.188) 0:02:28.338 ********** changed: [instance] TASK [libvirt_manager : Get virtual network information] *********************** Monday 16 March 2026 14:32:12 +0000 (0:00:00.277) 0:02:28.616 ********** ok: [instance] TASK [libvirt_manager : Create network to bridge mapping] ********************** Monday 16 March 2026 14:32:12 +0000 (0:00:00.224) 0:02:28.840 ********** ok: [instance] => (item=cifmw-public) ok: [instance] => (item=cifmw-osp_trunk) TASK [libvirt_manager : Dump domain xml] *************************************** Monday 16 March 2026 14:32:12 +0000 (0:00:00.041) 0:02:28.882 ********** ok: [instance] TASK [libvirt_manager : Extract networks from XML] ***************************** Monday 16 March 2026 14:32:12 +0000 (0:00:00.217) 0:02:29.100 ********** ok: [instance] TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* Monday 16 March 2026 14:32:12 +0000 (0:00:00.194) 0:02:29.294 ********** changed: [instance] TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* Monday 16 March 2026 14:32:13 +0000 (0:00:00.278) 0:02:29.572 ********** skipping: [instance] TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ Monday 16 March 2026 14:32:13 +0000 (0:00:00.021) 0:02:29.594 ********** skipping: [instance] TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** Monday 16 March 2026 14:32:13 +0000 (0:00:00.025) 0:02:29.619 ********** skipping: [instance] TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** Monday 16 March 2026 14:32:13 +0000 (0:00:00.024) 0:02:29.643 ********** skipping: [instance] TASK [libvirt_manager : Get VM UUID] ******************************************* Monday 16 March 2026 14:32:13 +0000 (0:00:00.024) 0:02:29.668 ********** changed: [instance] TASK [libvirt_manager : Inject UUID in dataset] ******************************** Monday 16 March 2026 14:32:13 +0000 (0:00:00.200) 0:02:29.869 ********** ok: [instance] TASK [libvirt_manager : Create cloud-init ISO] ********************************* Monday 16 March 2026 14:32:13 +0000 (0:00:00.037) 0:02:29.906 ********** skipping: [instance] TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** Monday 16 March 2026 14:32:13 +0000 (0:00:00.027) 0:02:29.933 ********** skipping: [instance] TASK [libvirt_manager : Attach additional devices if specified] **************** Monday 16 March 2026 14:32:13 +0000 (0:00:00.026) 0:02:29.960 ********** skipping: [instance] TASK [libvirt_manager : Configure boot order for crc-0] ************************ Monday 16 March 2026 14:32:13 +0000 (0:00:00.045) 0:02:30.006 ********** skipping: [instance] TASK [libvirt_manager : Start (power-on) VMs] ********************************** Monday 16 March 2026 14:32:13 +0000 (0:00:00.025) 0:02:30.031 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** Monday 16 March 2026 14:32:13 +0000 (0:00:00.061) 0:02:30.092 ********** ok: [instance] => (item=crc) TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** Monday 16 March 2026 14:32:13 +0000 (0:00:00.232) 0:02:30.325 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [libvirt_manager : Start vm] ********************************************** Monday 16 March 2026 14:32:15 +0000 (0:00:02.065) 0:02:32.391 ********** changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Monday 16 March 2026 14:32:16 +0000 (0:00:00.530) 0:02:32.921 ********** changed: [instance] TASK [libvirt_manager : Start vm] ********************************************** Monday 16 March 2026 14:32:16 +0000 (0:00:00.453) 0:02:33.375 ********** changed: [instance] TASK [libvirt_manager : Wait for SSH on started VMs] *************************** Monday 16 March 2026 14:32:17 +0000 (0:00:00.487) 0:02:33.862 ********** changed: [instance] => (item=compute-0.utility) changed: [instance] => (item=controller-0.utility) changed: [instance] => (item=crc-0.utility) TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** Monday 16 March 2026 14:32:18 +0000 (0:00:00.696) 0:02:34.559 ********** FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j904345384772.22371', 'results_file': '/home/zuul/.ansible_async/j904345384772.22371', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j870211079437.22388', 'results_file': '/home/zuul/.ansible_async/j870211079437.22388', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j730407619182.22404', 'results_file': '/home/zuul/.ansible_async/j730407619182.22404', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) TASK [libvirt_manager : Configure managed VMs] ********************************* Monday 16 March 2026 14:32:41 +0000 (0:00:22.975) 0:02:57.534 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) TASK [Check if new ssh keypair exists] ***************************************** Monday 16 March 2026 14:32:41 +0000 (0:00:00.110) 0:02:57.644 ********** skipping: [instance] TASK [Push ssh jumper/configuration for compute-0] ***************************** Monday 16 March 2026 14:32:41 +0000 (0:00:00.025) 0:02:57.670 ********** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Monday 16 March 2026 14:32:41 +0000 (0:00:00.041) 0:02:57.711 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Monday 16 March 2026 14:32:41 +0000 (0:00:00.094) 0:02:57.806 ********** changed: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Monday 16 March 2026 14:32:41 +0000 (0:00:00.225) 0:02:58.032 ********** changed: [instance] TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* Monday 16 March 2026 14:32:41 +0000 (0:00:00.217) 0:02:58.250 ********** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** Monday 16 March 2026 14:32:42 +0000 (0:00:00.385) 0:02:58.635 ********** skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Monday 16 March 2026 14:32:42 +0000 (0:00:00.028) 0:02:58.663 ********** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** Monday 16 March 2026 14:32:42 +0000 (0:00:00.028) 0:02:58.692 ********** skipping: [instance] TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** Monday 16 March 2026 14:32:42 +0000 (0:00:00.049) 0:02:58.741 ********** skipping: [instance] TASK [Check if new ssh keypair exists] ***************************************** Monday 16 March 2026 14:32:42 +0000 (0:00:00.044) 0:02:58.786 ********** skipping: [instance] TASK [Push ssh jumper/configuration for controller-0] ************************** Monday 16 March 2026 14:32:42 +0000 (0:00:00.022) 0:02:58.809 ********** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Monday 16 March 2026 14:32:42 +0000 (0:00:00.037) 0:02:58.846 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Monday 16 March 2026 14:32:42 +0000 (0:00:00.077) 0:02:58.924 ********** ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Monday 16 March 2026 14:32:42 +0000 (0:00:00.227) 0:02:59.152 ********** ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** Monday 16 March 2026 14:32:42 +0000 (0:00:00.222) 0:02:59.375 ********** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** Monday 16 March 2026 14:32:43 +0000 (0:00:00.404) 0:02:59.779 ********** skipping: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Monday 16 March 2026 14:32:43 +0000 (0:00:00.027) 0:02:59.807 ********** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts controller-0] ************** Monday 16 March 2026 14:32:43 +0000 (0:00:00.026) 0:02:59.834 ********** changed: [instance -> controller-0.instance] TASK [libvirt_manager : Inject public key on hosts controller-0] *************** Monday 16 March 2026 14:32:45 +0000 (0:00:01.644) 0:03:01.478 ********** changed: [instance -> controller-0.instance] TASK [Check if new ssh keypair exists] ***************************************** Monday 16 March 2026 14:32:46 +0000 (0:00:01.100) 0:03:02.578 ********** TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** Monday 16 March 2026 14:32:46 +0000 (0:00:00.038) 0:03:02.616 ********** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** Monday 16 March 2026 14:32:46 +0000 (0:00:00.226) 0:03:02.842 ********** ok: [instance] TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* Monday 16 March 2026 14:32:46 +0000 (0:00:00.026) 0:03:02.869 ********** skipping: [instance] TASK [Push ssh jumper/configuration for crc-0] ********************************* Monday 16 March 2026 14:32:46 +0000 (0:00:00.039) 0:03:02.908 ********** TASK [ssh_jumper : Create ssh-jumper entries] ********************************** Monday 16 March 2026 14:32:46 +0000 (0:00:00.049) 0:03:02.957 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* Monday 16 March 2026 14:32:46 +0000 (0:00:00.083) 0:03:03.040 ********** ok: [instance] TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** Monday 16 March 2026 14:32:46 +0000 (0:00:00.212) 0:03:03.253 ********** ok: [instance] TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** Monday 16 March 2026 14:32:47 +0000 (0:00:00.245) 0:03:03.498 ********** changed: [instance] TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** Monday 16 March 2026 14:32:47 +0000 (0:00:00.528) 0:03:04.027 ********** changed: [instance] TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* Monday 16 March 2026 14:32:48 +0000 (0:00:00.886) 0:03:04.914 ********** skipping: [instance] TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* Monday 16 March 2026 14:32:48 +0000 (0:00:00.028) 0:03:04.942 ********** skipping: [instance] TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** Monday 16 March 2026 14:32:48 +0000 (0:00:00.046) 0:03:04.989 ********** skipping: [instance] TASK [Create VBMC entity] ****************************************************** Monday 16 March 2026 14:32:48 +0000 (0:00:00.057) 0:03:05.047 ********** skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) skipping: [instance] TASK [libvirt_manager : List running virtual machines.] ************************ Monday 16 March 2026 14:32:48 +0000 (0:00:00.058) 0:03:05.105 ********** ok: [instance] TASK [libvirt_manager : Dump UUIDs] ******************************************** Monday 16 March 2026 14:32:48 +0000 (0:00:00.255) 0:03:05.360 ********** changed: [instance] TASK [Ensure fresh vbmc listing] *********************************************** Monday 16 March 2026 14:32:49 +0000 (0:00:00.398) 0:03:05.759 ********** skipping: [instance] TASK [libvirt_manager : Update vbmc related fact] ****************************** Monday 16 March 2026 14:32:49 +0000 (0:00:00.042) 0:03:05.802 ********** skipping: [instance] TASK [libvirt_manager : Dump vbmc known hosts] ********************************* Monday 16 March 2026 14:32:49 +0000 (0:00:00.040) 0:03:05.842 ********** skipping: [instance] TASK [libvirt_manager : Copy authorized_keys] ********************************** Monday 16 March 2026 14:32:49 +0000 (0:00:00.043) 0:03:05.885 ********** changed: [instance] TASK [libvirt_manager : Enable root access on CRC] ***************************** Monday 16 March 2026 14:32:50 +0000 (0:00:00.793) 0:03:06.678 ********** changed: [instance] TASK [reproducer : Get deployed VM group inventories] ************************** Monday 16 March 2026 14:32:51 +0000 (0:00:00.809) 0:03:07.488 ********** skipping: [instance] TASK [reproducer : Inject remote inventories onto main hypervisor] ************* Monday 16 March 2026 14:32:51 +0000 (0:00:00.045) 0:03:07.534 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) TASK [reproducer : Gather inventories from instance] *************************** Monday 16 March 2026 14:32:51 +0000 (0:00:00.071) 0:03:07.606 ********** skipping: [instance] TASK [reproducer : Gather inventories from compute-0] ************************** Monday 16 March 2026 14:32:51 +0000 (0:00:00.051) 0:03:07.657 ********** skipping: [instance] TASK [reproducer : Gather inventories from controller-0] *********************** Monday 16 March 2026 14:32:51 +0000 (0:00:00.039) 0:03:07.696 ********** skipping: [instance] TASK [reproducer : Gather inventories from crc-0] ****************************** Monday 16 March 2026 14:32:51 +0000 (0:00:00.043) 0:03:07.740 ********** skipping: [instance] TASK [reproducer : Push generated inventory from hypervisor] ******************* Monday 16 March 2026 14:32:51 +0000 (0:00:00.042) 0:03:07.783 ********** changed: [instance] TASK [reproducer : Slurp devscripts private key] ******************************* Monday 16 March 2026 14:32:52 +0000 (0:00:00.677) 0:03:08.460 ********** skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** Monday 16 March 2026 14:32:52 +0000 (0:00:00.038) 0:03:08.498 ********** skipping: [instance] TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* Monday 16 March 2026 14:32:52 +0000 (0:00:00.034) 0:03:08.533 ********** skipping: [instance] TASK [openshift_login : Assert we have needed parameters] ********************** Monday 16 March 2026 14:32:52 +0000 (0:00:00.039) 0:03:08.572 ********** skipping: [instance] TASK [openshift_login : Stat kubeconfig] *************************************** Monday 16 March 2026 14:32:52 +0000 (0:00:00.035) 0:03:08.607 ********** skipping: [instance] TASK [openshift_login : Stat kubeadmin] **************************************** Monday 16 March 2026 14:32:52 +0000 (0:00:00.046) 0:03:08.653 ********** skipping: [instance] TASK [openshift_login : Assert files exist] ************************************ Monday 16 March 2026 14:32:52 +0000 (0:00:00.045) 0:03:08.699 ********** skipping: [instance] TASK [openshift_login : Gather the password of the deployed cluster.] ********** Monday 16 March 2026 14:32:52 +0000 (0:00:00.041) 0:03:08.741 ********** skipping: [instance] TASK [openshift_login : Gather the deployed OCP configuration.] **************** Monday 16 March 2026 14:32:52 +0000 (0:00:00.037) 0:03:08.778 ********** skipping: [instance] TASK [openshift_login : Set the OpenShift platform access information.] ******** Monday 16 March 2026 14:32:52 +0000 (0:00:00.042) 0:03:08.821 ********** skipping: [instance] TASK [reproducer : Set fact for later wait on OCP cluster] ********************* Monday 16 March 2026 14:32:52 +0000 (0:00:00.050) 0:03:08.871 ********** skipping: [instance] TASK [reproducer : Configure Controller node] ********************************** Monday 16 March 2026 14:32:52 +0000 (0:00:00.038) 0:03:08.909 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance TASK [reproducer : Ensure directories exist] *********************************** Monday 16 March 2026 14:32:52 +0000 (0:00:00.160) 0:03:09.069 ********** changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Tweak dnf configuration] ************************************ Monday 16 March 2026 14:32:54 +0000 (0:00:01.408) 0:03:10.478 ********** skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Monday 16 March 2026 14:32:54 +0000 (0:00:00.019) 0:03:10.497 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Monday 16 March 2026 14:32:54 +0000 (0:00:00.607) 0:03:11.104 ********** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Monday 16 March 2026 14:32:54 +0000 (0:00:00.034) 0:03:11.138 ********** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Monday 16 March 2026 14:32:54 +0000 (0:00:00.034) 0:03:11.173 ********** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Monday 16 March 2026 14:32:54 +0000 (0:00:00.035) 0:03:11.208 ********** skipping: [instance] TASK [reproducer : Get rhos-release] ******************************************* Monday 16 March 2026 14:32:54 +0000 (0:00:00.040) 0:03:11.249 ********** skipping: [instance] TASK [reproducer : Install repos] ********************************************** Monday 16 March 2026 14:32:54 +0000 (0:00:00.031) 0:03:11.281 ********** skipping: [instance] TASK [reproducer : Run custom commands after rhos-release setup] *************** Monday 16 March 2026 14:32:54 +0000 (0:00:00.037) 0:03:11.318 ********** skipping: [instance] TASK [reproducer : Create bundle for CRC] ************************************** Monday 16 March 2026 14:32:54 +0000 (0:00:00.032) 0:03:11.351 ********** skipping: [instance] TASK [reproducer : Install some tools] ***************************************** Monday 16 March 2026 14:32:54 +0000 (0:00:00.030) 0:03:11.381 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject command aliases for faster debugging] **************** Monday 16 March 2026 14:32:55 +0000 (0:00:01.016) 0:03:12.398 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Build job inventory for hook usage] ************************* Monday 16 March 2026 14:32:57 +0000 (0:00:01.067) 0:03:13.465 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Push the MAC mapping data] ********************************** Monday 16 March 2026 14:32:57 +0000 (0:00:00.599) 0:03:14.064 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject other Hypervisor SSH keys] *************************** Monday 16 March 2026 14:32:58 +0000 (0:00:00.941) 0:03:15.006 ********** changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** Monday 16 March 2026 14:32:59 +0000 (0:00:01.050) 0:03:16.056 ********** changed: [instance -> controller-0(controller-0.instance)] => (item=instance) skipping: [instance] => (item=compute-0) skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) TASK [reproducer : Inject SSH configuration] *********************************** Monday 16 March 2026 14:33:00 +0000 (0:00:00.705) 0:03:16.762 ********** skipping: [instance] => (item=instance) changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) TASK [reproducer : Create kube directory] ************************************** Monday 16 March 2026 14:33:02 +0000 (0:00:01.857) 0:03:18.619 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeconfig content] ********************************** Monday 16 March 2026 14:33:02 +0000 (0:00:00.615) 0:03:19.235 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject kubeadmin-password if exists] ************************ Monday 16 March 2026 14:33:04 +0000 (0:00:01.191) 0:03:20.426 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject devscripts private key if set] *********************** Monday 16 March 2026 14:33:05 +0000 (0:00:01.030) 0:03:21.456 ********** skipping: [instance] TASK [reproducer : Ensure /etc/ci/env is created] ****************************** Monday 16 March 2026 14:33:05 +0000 (0:00:00.041) 0:03:21.498 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Ensure directory tree exist] **************************** Monday 16 March 2026 14:33:05 +0000 (0:00:00.626) 0:03:22.124 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Assert we get needed data] ****************************** Monday 16 March 2026 14:33:06 +0000 (0:00:00.611) 0:03:22.735 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Push reproducer secrets] ******************************** Monday 16 March 2026 14:33:06 +0000 (0:00:00.045) 0:03:22.781 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) TASK [manage_secrets : Debug _secret_dest] ************************************* Monday 16 March 2026 14:33:06 +0000 (0:00:00.068) 0:03:22.849 ********** ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt TASK [manage_secrets : Debug _secret_file] ************************************* Monday 16 March 2026 14:33:06 +0000 (0:00:00.058) 0:03:22.908 ********** ok: [instance -> controller-0(controller-0.instance)] => _secret_file: '' TASK [manage_secrets : Debug _secret_content] ********************************** Monday 16 March 2026 14:33:06 +0000 (0:00:00.052) 0:03:22.960 ********** ok: [instance -> controller-0(controller-0.instance)] => _secret_content: my-default-location-place TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Monday 16 March 2026 14:33:06 +0000 (0:00:00.051) 0:03:23.012 ********** skipping: [instance] TASK [manage_secrets : Check if pull secret src file exists] ******************* Monday 16 March 2026 14:33:06 +0000 (0:00:00.049) 0:03:23.062 ********** skipping: [instance] TASK [manage_secrets : Copy file to location] ********************************** Monday 16 March 2026 14:33:06 +0000 (0:00:00.053) 0:03:23.115 ********** skipping: [instance] TASK [manage_secrets : Create file from content] ******************************* Monday 16 March 2026 14:33:06 +0000 (0:00:00.048) 0:03:23.164 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Debug _secret_dest] ************************************* Monday 16 March 2026 14:33:07 +0000 (0:00:00.988) 0:03:24.152 ********** ok: [instance -> controller-0(controller-0.instance)] => _secret_dest: /home/zuul/ipmi-things TASK [manage_secrets : Debug _secret_file] ************************************* Monday 16 March 2026 14:33:07 +0000 (0:00:00.054) 0:03:24.207 ********** ok: [instance -> controller-0(controller-0.instance)] => _secret_file: /tmp/ipmi-things TASK [manage_secrets : Debug _secret_content] ********************************** Monday 16 March 2026 14:33:07 +0000 (0:00:00.048) 0:03:24.255 ********** ok: [instance -> controller-0(controller-0.instance)] => _secret_content: '' TASK [manage_secrets : Ensure parameter is an absolute path] ******************* Monday 16 March 2026 14:33:07 +0000 (0:00:00.049) 0:03:24.305 ********** ok: [instance -> controller-0(controller-0.instance)] => changed=false msg: All assertions passed TASK [manage_secrets : Check if pull secret src file exists] ******************* Monday 16 March 2026 14:33:07 +0000 (0:00:00.056) 0:03:24.361 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Copy file to location] ********************************** Monday 16 March 2026 14:33:08 +0000 (0:00:00.599) 0:03:24.961 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [manage_secrets : Create file from content] ******************************* Monday 16 March 2026 14:33:09 +0000 (0:00:01.075) 0:03:26.037 ********** skipping: [instance] TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** Monday 16 March 2026 14:33:09 +0000 (0:00:00.059) 0:03:26.096 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check if async file is still available] ********************* Monday 16 March 2026 14:33:10 +0000 (0:00:00.634) 0:03:26.730 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check package install status] ******************************* Monday 16 March 2026 14:33:11 +0000 (0:00:00.735) 0:03:27.466 ********** FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** Monday 16 March 2026 14:33:56 +0000 (0:00:45.480) 0:04:12.946 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Install required packages] ****************************** Monday 16 March 2026 14:33:57 +0000 (0:00:00.642) 0:04:13.588 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get ingresses domain] *********************************** Monday 16 March 2026 14:33:59 +0000 (0:00:02.546) 0:04:16.135 ********** skipping: [instance] TASK [sushy_emulator : Set sushy url for ocp installation] ********************* Monday 16 March 2026 14:33:59 +0000 (0:00:00.050) 0:04:16.185 ********** skipping: [instance] TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** Monday 16 March 2026 14:33:59 +0000 (0:00:00.050) 0:04:16.236 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp private ssh key for later use] ******************** Monday 16 March 2026 14:34:01 +0000 (0:00:01.664) 0:04:17.901 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* Monday 16 March 2026 14:34:02 +0000 (0:00:00.540) 0:04:18.441 ********** changed: [instance] TASK [sushy_emulator : Run ssh-keyscan] **************************************** Monday 16 March 2026 14:34:02 +0000 (0:00:00.306) 0:04:18.747 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write known hosts for later use] ************************ Monday 16 March 2026 14:34:03 +0000 (0:00:00.782) 0:04:19.529 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Monday 16 March 2026 14:34:04 +0000 (0:00:01.207) 0:04:20.736 ********** skipping: [instance] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Monday 16 March 2026 14:34:04 +0000 (0:00:00.049) 0:04:20.786 ********** skipping: [instance] TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** Monday 16 March 2026 14:34:04 +0000 (0:00:00.049) 0:04:20.835 ********** skipping: [instance] TASK [sushy_emulator : Generate list of filtered VMs] ************************** Monday 16 March 2026 14:34:04 +0000 (0:00:00.045) 0:04:20.881 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** Monday 16 March 2026 14:34:04 +0000 (0:00:00.060) 0:04:20.941 ********** skipping: [instance] TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** Monday 16 March 2026 14:34:04 +0000 (0:00:00.048) 0:04:20.990 ********** skipping: [instance] TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** Monday 16 March 2026 14:34:04 +0000 (0:00:00.043) 0:04:21.033 ********** skipping: [instance] TASK [sushy_emulator : Generate htpasswd string] ******************************* Monday 16 March 2026 14:34:04 +0000 (0:00:00.044) 0:04:21.078 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write sushy emulator resource loop] ********************* Monday 16 March 2026 14:34:05 +0000 (0:00:00.727) 0:04:21.805 ********** skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=pod) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Write sushy emulator config] **************************** Monday 16 March 2026 14:34:05 +0000 (0:00:00.120) 0:04:21.926 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Write htpasswd string to file] ************************** Monday 16 March 2026 14:34:06 +0000 (0:00:01.306) 0:04:23.232 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** Monday 16 March 2026 14:34:07 +0000 (0:00:01.056) 0:04:24.289 ********** skipping: [instance] TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** Monday 16 March 2026 14:34:07 +0000 (0:00:00.046) 0:04:24.336 ********** skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* Monday 16 March 2026 14:34:07 +0000 (0:00:00.040) 0:04:24.377 ********** skipping: [instance] => (item=secret) skipping: [instance] => (item=configmap) skipping: [instance] => (item=service) skipping: [instance] => (item=route) skipping: [instance] TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** Monday 16 March 2026 14:34:08 +0000 (0:00:00.089) 0:04:24.466 ********** skipping: [instance] TASK [podman : Ensure podman is installed] ************************************* Monday 16 March 2026 14:34:08 +0000 (0:00:00.045) 0:04:24.512 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [podman : Enable loginctl linger for ansible_user_id] ********************* Monday 16 March 2026 14:34:09 +0000 (0:00:01.777) 0:04:26.289 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* Monday 16 March 2026 14:34:10 +0000 (0:00:00.914) 0:04:27.203 ********** skipping: [instance] TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* Monday 16 March 2026 14:34:10 +0000 (0:00:00.061) 0:04:27.265 ********** skipping: [instance] TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** Monday 16 March 2026 14:34:10 +0000 (0:00:00.056) 0:04:27.321 ********** skipping: [instance] TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** Monday 16 March 2026 14:34:10 +0000 (0:00:00.074) 0:04:27.396 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Create and start Sushy Emulator container] ************** Monday 16 March 2026 14:34:23 +0000 (0:00:12.109) 0:04:39.505 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure directories exist] *********************************** Monday 16 March 2026 14:34:24 +0000 (0:00:01.748) 0:04:41.254 ********** ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) TASK [reproducer : Convert VBMC list into a dict for better usage] ************* Monday 16 March 2026 14:34:26 +0000 (0:00:01.349) 0:04:42.603 ********** skipping: [instance] TASK [reproducer : Check if baremetal-info.yml exists] ************************* Monday 16 March 2026 14:34:26 +0000 (0:00:00.045) 0:04:42.648 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get content of baremetal-info file] ************************* Monday 16 March 2026 14:34:27 +0000 (0:00:00.787) 0:04:43.436 ********** skipping: [instance] TASK [reproducer : Interpret remote file content as yaml] ********************** Monday 16 March 2026 14:34:27 +0000 (0:00:00.043) 0:04:43.479 ********** skipping: [instance] TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Monday 16 March 2026 14:34:27 +0000 (0:00:00.058) 0:04:43.538 ********** skipping: [instance] TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** Monday 16 March 2026 14:34:27 +0000 (0:00:00.061) 0:04:43.600 ********** skipping: [instance] TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** Monday 16 March 2026 14:34:27 +0000 (0:00:00.049) 0:04:43.649 ********** ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) TASK [reproducer : Output baremetal info file] ********************************* Monday 16 March 2026 14:34:27 +0000 (0:00:00.136) 0:04:43.786 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Output ironic_nodes to file] ******************************** Monday 16 March 2026 14:34:28 +0000 (0:00:01.157) 0:04:44.943 ********** skipping: [instance] TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* Monday 16 March 2026 14:34:28 +0000 (0:00:00.047) 0:04:44.990 ********** TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** Monday 16 March 2026 14:34:28 +0000 (0:00:00.129) 0:04:45.120 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Monday 16 March 2026 14:34:28 +0000 (0:00:00.062) 0:04:45.182 ********** skipping: [instance] TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** Monday 16 March 2026 14:34:28 +0000 (0:00:00.057) 0:04:45.239 ********** skipping: [instance] TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** Monday 16 March 2026 14:34:28 +0000 (0:00:00.048) 0:04:45.288 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** Monday 16 March 2026 14:34:30 +0000 (0:00:01.510) 0:04:46.798 ********** ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) TASK [sushy_emulator : Verify baremetal VM power status] *********************** Monday 16 March 2026 14:34:38 +0000 (0:00:07.883) 0:04:54.681 ********** ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** Monday 16 March 2026 14:34:38 +0000 (0:00:00.165) 0:04:54.847 ********** ok: [instance -> localhost] TASK [reproducer : Sync local repositories to other hosts if present] ********** Monday 16 March 2026 14:34:38 +0000 (0:00:00.277) 0:04:55.125 ********** changed: [instance -> localhost] => (item=controller-0) TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** Monday 16 March 2026 14:34:40 +0000 (0:00:01.908) 0:04:57.033 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install ansible dependencies] ******************************* Monday 16 March 2026 14:34:41 +0000 (0:00:00.686) 0:04:57.719 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** Monday 16 March 2026 14:34:42 +0000 (0:00:00.828) 0:04:58.548 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** Monday 16 March 2026 14:34:43 +0000 (0:00:01.149) 0:04:59.698 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject local environment parameters] ************************ Monday 16 March 2026 14:34:43 +0000 (0:00:00.663) 0:05:00.361 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Create openshift-environment.yml symlink to old location] *** Monday 16 March 2026 14:34:45 +0000 (0:00:01.106) 0:05:01.468 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Get interfaces-info content] ******************************** Monday 16 March 2026 14:34:45 +0000 (0:00:00.584) 0:05:02.052 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Wait for OCP nodes to be ready] ***************************** Monday 16 March 2026 14:34:46 +0000 (0:00:00.632) 0:05:02.685 ********** ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) TASK [networking_mapper : Check for Networking Definition file existence] ****** Monday 16 March 2026 14:34:47 +0000 (0:00:01.427) 0:05:04.113 ********** skipping: [instance] TASK [networking_mapper : Load the Networking Definition from file] ************ Monday 16 March 2026 14:34:47 +0000 (0:00:00.039) 0:05:04.153 ********** skipping: [instance] TASK [networking_mapper : Check for interfaces info file existence] ************ Monday 16 March 2026 14:34:47 +0000 (0:00:00.035) 0:05:04.188 ********** skipping: [instance] TASK [networking_mapper : Load the interfaces info from file] ****************** Monday 16 March 2026 14:34:47 +0000 (0:00:00.038) 0:05:04.227 ********** skipping: [instance] TASK [networking_mapper : Ensure local fact is empty] ************************** Monday 16 March 2026 14:34:47 +0000 (0:00:00.037) 0:05:04.264 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** Monday 16 March 2026 14:34:47 +0000 (0:00:00.038) 0:05:04.303 ********** ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) ok: [instance -> controller-0(controller-0.instance)] => (item={}) TASK [networking_mapper : Gather facts if requested] *************************** Monday 16 March 2026 14:34:48 +0000 (0:00:00.150) 0:05:04.453 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance TASK [networking_mapper : Gather the facts] ************************************ Monday 16 March 2026 14:34:48 +0000 (0:00:00.051) 0:05:04.505 ********** ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** Monday 16 March 2026 14:34:51 +0000 (0:00:03.574) 0:05:08.079 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** Monday 16 March 2026 14:34:52 +0000 (0:00:00.987) 0:05:09.067 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Definition to file] ************* Monday 16 March 2026 14:34:53 +0000 (0:00:00.484) 0:05:09.551 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Call the networking mapper] ************************** Monday 16 March 2026 14:34:54 +0000 (0:00:00.928) 0:05:10.479 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Set networking mapper facts] ************************* Monday 16 March 2026 14:34:54 +0000 (0:00:00.090) 0:05:10.570 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [networking_mapper : Write the Networking Environment Definition to file] *** Monday 16 March 2026 14:34:54 +0000 (0:00:00.059) 0:05:10.629 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CRC ssh key] ***************************************** Monday 16 March 2026 14:34:55 +0000 (0:00:00.987) 0:05:11.616 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Ensure we have all dependencies installed] ****************** Monday 16 March 2026 14:34:56 +0000 (0:00:01.071) 0:05:12.688 ********** FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). changed: [instance -> controller-0(controller-0.instance)] TASK [Configure ntp service] *************************************************** Monday 16 March 2026 14:35:02 +0000 (0:00:06.000) 0:05:18.688 ********** TASK [cifmw_ntp : Install chrony] ********************************************** Monday 16 March 2026 14:35:02 +0000 (0:00:00.188) 0:05:18.877 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Configure original chrony.conf file] ************************* Monday 16 March 2026 14:35:03 +0000 (0:00:01.042) 0:05:19.920 ********** ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) TASK [cifmw_ntp : Render chrony extra config file] ***************************** Monday 16 March 2026 14:35:04 +0000 (0:00:01.037) 0:05:20.957 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [cifmw_ntp : Enable chrony service] *************************************** Monday 16 March 2026 14:35:05 +0000 (0:00:00.988) 0:05:21.945 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Configure CRC node if available] **************************** Monday 16 March 2026 14:35:06 +0000 (0:00:00.659) 0:05:22.605 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance TASK [reproducer : Get the networking-environment-definition from controller-0] *** Monday 16 March 2026 14:35:06 +0000 (0:00:00.130) 0:05:22.735 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Check which dnsmasq config we must edit] ******************** Monday 16 March 2026 14:35:06 +0000 (0:00:00.480) 0:05:23.216 ********** ok: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Configure local DNS for CRC pod] **************************** Monday 16 March 2026 14:35:07 +0000 (0:00:00.565) 0:05:23.781 ********** changed: [instance -> crc-0(crc-0.instance)] TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** Monday 16 March 2026 14:35:07 +0000 (0:00:00.627) 0:05:24.409 ********** changed: [instance -> crc-0(crc-0.instance)] TASK [Restart DNS in CRC VM] *************************************************** Monday 16 March 2026 14:35:08 +0000 (0:00:00.585) 0:05:24.994 ********** TASK [openshift_setup : Check which dnsmasq config we must edit] *************** Monday 16 March 2026 14:35:08 +0000 (0:00:00.047) 0:05:25.042 ********** ok: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Restart dnsmasq service if used] *********************** Monday 16 March 2026 14:35:09 +0000 (0:00:00.492) 0:05:25.534 ********** changed: [instance -> crc-0(crc-0.instance)] TASK [openshift_setup : Stop dnsmasq] ****************************************** Monday 16 March 2026 14:35:09 +0000 (0:00:00.762) 0:05:26.297 ********** skipping: [instance] TASK [openshift_setup : Start dnsmasq] ***************************************** Monday 16 March 2026 14:35:09 +0000 (0:00:00.033) 0:05:26.330 ********** skipping: [instance] TASK [reproducer : Remove entry from /etc/hosts] ******************************* Monday 16 March 2026 14:35:09 +0000 (0:00:00.038) 0:05:26.369 ********** changed: [instance] TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** Monday 16 March 2026 14:35:10 +0000 (0:00:00.232) 0:05:26.601 ********** skipping: [instance] => (item=) TASK [dnsmasq : Assert we have needed address data] **************************** Monday 16 March 2026 14:35:10 +0000 (0:00:00.077) 0:05:26.678 ********** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Monday 16 March 2026 14:35:10 +0000 (0:00:00.042) 0:05:26.720 ********** ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Monday 16 March 2026 14:35:10 +0000 (0:00:00.082) 0:05:26.802 ********** changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ Monday 16 March 2026 14:35:10 +0000 (0:00:00.242) 0:05:27.045 ********** TASK [dnsmasq : Assert we have needed host record data] ************************ Monday 16 March 2026 14:35:10 +0000 (0:00:00.049) 0:05:27.094 ********** ok: [instance] TASK [dnsmasq : Assert each address element have needed data] ****************** Monday 16 March 2026 14:35:10 +0000 (0:00:00.060) 0:05:27.155 ********** ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [dnsmasq : Add/Remove address] ******************************************** Monday 16 March 2026 14:35:10 +0000 (0:00:00.061) 0:05:27.217 ********** changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** Monday 16 March 2026 14:35:11 +0000 (0:00:00.246) 0:05:27.463 ********** skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) skipping: [instance] TASK [dnsmasq : Remove crc.testing from host_records] ************************** Monday 16 March 2026 14:35:11 +0000 (0:00:00.054) 0:05:27.518 ********** skipping: [instance] TASK [reproducer : Ensure "testing" domain is "local"] ************************* Monday 16 March 2026 14:35:11 +0000 (0:00:00.034) 0:05:27.552 ********** changed: [instance] TASK [reproducer : Flush handlers] ********************************************* Monday 16 March 2026 14:35:11 +0000 (0:00:00.396) 0:05:27.949 ********** RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** Monday 16 March 2026 14:35:11 +0000 (0:00:00.013) 0:05:27.962 ********** changed: [instance -> controller-0(controller-0.instance)] RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ Monday 16 March 2026 14:35:12 +0000 (0:00:00.706) 0:05:28.669 ********** changed: [instance] TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** Monday 16 March 2026 14:35:12 +0000 (0:00:00.374) 0:05:29.043 ********** skipping: [instance] => (item=controller-0) skipping: [instance] => (item=crc-0) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** Monday 16 March 2026 14:35:12 +0000 (0:00:00.172) 0:05:29.215 ********** changed: [instance -> compute-0(compute-0.instance)] TASK [reproducer : Tweak dnf configuration] ************************************ Monday 16 March 2026 14:35:14 +0000 (0:00:01.511) 0:05:30.726 ********** skipping: [instance] TASK [install_ca : Ensure target directory exists] ***************************** Monday 16 March 2026 14:35:14 +0000 (0:00:00.020) 0:05:30.746 ********** ok: [instance -> compute-0(compute-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Monday 16 March 2026 14:35:14 +0000 (0:00:00.558) 0:05:31.305 ********** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Monday 16 March 2026 14:35:14 +0000 (0:00:00.035) 0:05:31.340 ********** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Monday 16 March 2026 14:35:14 +0000 (0:00:00.040) 0:05:31.380 ********** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Monday 16 March 2026 14:35:14 +0000 (0:00:00.034) 0:05:31.415 ********** skipping: [instance] TASK [reproducer : Get rhos-release and setup repos] *************************** Monday 16 March 2026 14:35:15 +0000 (0:00:00.038) 0:05:31.454 ********** skipping: [instance] TASK [reproducer : Create repositories on computes] **************************** Monday 16 March 2026 14:35:15 +0000 (0:00:00.034) 0:05:31.489 ********** skipping: [instance] TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* Monday 16 March 2026 14:35:15 +0000 (0:00:00.019) 0:05:31.509 ********** skipping: [instance] TASK [reproducer : Discover and expose CI Framework path on remote node] ******* Monday 16 March 2026 14:35:15 +0000 (0:00:00.029) 0:05:31.539 ********** ok: [instance] TASK [reproducer : Push local code] ******************************************** Monday 16 March 2026 14:35:15 +0000 (0:00:00.060) 0:05:31.600 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance TASK [reproducer : Check if repository directories already exist] ************** Monday 16 March 2026 14:35:15 +0000 (0:00:00.100) 0:05:31.700 ********** skipping: [instance] TASK [reproducer : Ensure we are not in the job_id branch] ********************* Monday 16 March 2026 14:35:15 +0000 (0:00:00.040) 0:05:31.740 ********** skipping: [instance] TASK [reproducer : Fetch zuul.items repositories] ****************************** Monday 16 March 2026 14:35:15 +0000 (0:00:00.041) 0:05:31.782 ********** skipping: [instance] TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** Monday 16 March 2026 14:35:15 +0000 (0:00:00.041) 0:05:31.823 ********** skipping: [instance] TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** Monday 16 March 2026 14:35:15 +0000 (0:00:00.039) 0:05:31.863 ********** skipping: [instance] TASK [reproducer : Create target directories beforehand] *********************** Monday 16 March 2026 14:35:15 +0000 (0:00:00.036) 0:05:31.900 ********** ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) TASK [reproducer : Sync local repositories to ansible controller] ************** Monday 16 March 2026 14:35:15 +0000 (0:00:00.481) 0:05:32.382 ********** ok: [instance -> localhost] => (item=ci-framework) TASK [reproducer : Sync remote repositories] *********************************** Monday 16 March 2026 14:35:16 +0000 (0:00:00.582) 0:05:32.964 ********** skipping: [instance] => (item=ci-framework) skipping: [instance] TASK [reproducer : Ensure default repositories are present] ******************** Monday 16 March 2026 14:35:16 +0000 (0:00:00.041) 0:05:33.006 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) TASK [reproducer : Check repository availability: ci-framework] **************** Monday 16 March 2026 14:35:16 +0000 (0:00:00.076) 0:05:33.082 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: ci-framework] ******************* Monday 16 March 2026 14:35:17 +0000 (0:00:00.476) 0:05:33.559 ********** skipping: [instance] TASK [reproducer : Check repository availability: install_yamls] *************** Monday 16 March 2026 14:35:17 +0000 (0:00:00.039) 0:05:33.598 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: install_yamls] ****************** Monday 16 March 2026 14:35:17 +0000 (0:00:00.465) 0:05:34.064 ********** skipping: [instance] TASK [reproducer : Check repository availability: architecture] **************** Monday 16 March 2026 14:35:17 +0000 (0:00:00.037) 0:05:34.101 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Clone repository if needed: architecture] ******************* Monday 16 March 2026 14:35:18 +0000 (0:00:00.450) 0:05:34.552 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Install collections on controller-0] ************************ Monday 16 March 2026 14:35:20 +0000 (0:00:02.482) 0:05:37.034 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Inject CI Framework motd] *********************************** Monday 16 March 2026 14:35:41 +0000 (0:00:20.975) 0:05:58.010 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate some logs] ******************************************* Monday 16 March 2026 14:35:42 +0000 (0:00:01.098) 0:05:59.108 ********** included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* Monday 16 March 2026 14:35:42 +0000 (0:00:00.109) 0:05:59.218 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [reproducer : Rotate log if present] ************************************** Monday 16 March 2026 14:35:43 +0000 (0:00:00.510) 0:05:59.728 ********** skipping: [instance] TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** Monday 16 March 2026 14:35:43 +0000 (0:00:00.040) 0:05:59.768 ********** skipping: [instance] TASK [cifmw_setup : Get customized parameters] ********************************* Monday 16 March 2026 14:35:43 +0000 (0:00:00.042) 0:05:59.810 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Ensure target directory exists] ***************************** Monday 16 March 2026 14:35:43 +0000 (0:00:00.117) 0:05:59.928 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [install_ca : Install internal CA from url] ******************************* Monday 16 March 2026 14:35:44 +0000 (0:00:00.536) 0:06:00.465 ********** skipping: [instance] TASK [install_ca : Install custom CA bundle from inline] *********************** Monday 16 March 2026 14:35:44 +0000 (0:00:00.043) 0:06:00.508 ********** skipping: [instance] TASK [install_ca : Install custom CA bundle from file] ************************* Monday 16 March 2026 14:35:44 +0000 (0:00:00.041) 0:06:00.550 ********** skipping: [instance] TASK [install_ca : Update ca bundle] ******************************************* Monday 16 March 2026 14:35:44 +0000 (0:00:00.050) 0:06:00.600 ********** skipping: [instance] TASK [repo_setup : Ensure directories are present] ***************************** Monday 16 March 2026 14:35:44 +0000 (0:00:00.053) 0:06:00.654 ********** changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [repo_setup : Make sure git-core package is installed] ******************** Monday 16 March 2026 14:35:45 +0000 (0:00:01.558) 0:06:02.213 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Get repo-setup repository] ********************************** Monday 16 March 2026 14:35:46 +0000 (0:00:01.102) 0:06:03.315 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Initialize python venv and install requirements] ************ Monday 16 March 2026 14:35:48 +0000 (0:00:01.373) 0:06:04.689 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Install repo-setup package] ********************************* Monday 16 March 2026 14:35:55 +0000 (0:00:07.652) 0:06:12.342 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Monday 16 March 2026 14:35:56 +0000 (0:00:00.977) 0:06:13.319 ********** skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Monday 16 March 2026 14:35:56 +0000 (0:00:00.046) 0:06:13.365 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Get component repo] ***************************************** Monday 16 March 2026 14:35:58 +0000 (0:00:01.943) 0:06:15.308 ********** skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Monday 16 March 2026 14:35:58 +0000 (0:00:00.055) 0:06:15.364 ********** skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Monday 16 March 2026 14:35:58 +0000 (0:00:00.052) 0:06:15.416 ********** skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Monday 16 March 2026 14:35:59 +0000 (0:00:00.061) 0:06:15.478 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Monday 16 March 2026 14:35:59 +0000 (0:00:00.858) 0:06:16.336 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Dump current-podified hash] ********************************* Monday 16 March 2026 14:36:00 +0000 (0:00:00.896) 0:06:17.233 ********** skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Monday 16 March 2026 14:36:00 +0000 (0:00:00.038) 0:06:17.271 ********** skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Monday 16 March 2026 14:36:00 +0000 (0:00:00.037) 0:06:17.309 ********** skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Monday 16 March 2026 14:36:00 +0000 (0:00:00.040) 0:06:17.350 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Create download directory] ********************************** Monday 16 March 2026 14:36:00 +0000 (0:00:00.052) 0:06:17.402 ********** skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Monday 16 March 2026 14:36:01 +0000 (0:00:00.037) 0:06:17.439 ********** skipping: [instance] TASK [Download the RPM] ******************************************************** Monday 16 March 2026 14:36:01 +0000 (0:00:00.037) 0:06:17.476 ********** skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Monday 16 March 2026 14:36:01 +0000 (0:00:00.037) 0:06:17.514 ********** skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Monday 16 March 2026 14:36:01 +0000 (0:00:00.045) 0:06:17.559 ********** skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Monday 16 March 2026 14:36:01 +0000 (0:00:00.040) 0:06:17.600 ********** skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Monday 16 March 2026 14:36:01 +0000 (0:00:00.044) 0:06:17.644 ********** skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Monday 16 March 2026 14:36:01 +0000 (0:00:00.041) 0:06:17.685 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Monday 16 March 2026 14:36:01 +0000 (0:00:00.481) 0:06:18.167 ********** skipping: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Monday 16 March 2026 14:36:01 +0000 (0:00:00.062) 0:06:18.230 ********** skipping: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Monday 16 March 2026 14:36:01 +0000 (0:00:00.054) 0:06:18.285 ********** skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Monday 16 March 2026 14:36:01 +0000 (0:00:00.046) 0:06:18.331 ********** skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Monday 16 March 2026 14:36:01 +0000 (0:00:00.051) 0:06:18.383 ********** skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Monday 16 March 2026 14:36:02 +0000 (0:00:00.048) 0:06:18.432 ********** skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Monday 16 March 2026 14:36:02 +0000 (0:00:00.051) 0:06:18.483 ********** skipping: [instance] TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** Monday 16 March 2026 14:36:02 +0000 (0:00:00.059) 0:06:18.543 ********** skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Monday 16 March 2026 14:36:02 +0000 (0:00:00.053) 0:06:18.597 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Monday 16 March 2026 14:36:02 +0000 (0:00:00.628) 0:06:19.225 ********** changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0(controller-0.instance)] => (item=None) changed: [instance -> controller-0] TASK [repo_setup : Cleanup existing metadata] ********************************** Monday 16 March 2026 14:36:03 +0000 (0:00:01.045) 0:06:20.271 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Monday 16 March 2026 14:36:04 +0000 (0:00:00.766) 0:06:21.038 ********** changed: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Gather variables for each operating system] ******************* Monday 16 March 2026 14:36:05 +0000 (0:00:00.544) 0:06:21.582 ********** ok: [instance -> controller-0(controller-0.instance)] => (item=None) ok: [instance -> controller-0] TASK [ci_setup : List packages to install] ************************************* Monday 16 March 2026 14:36:05 +0000 (0:00:00.062) 0:06:21.645 ********** ok: [instance -> controller-0(controller-0.instance)] TASK [ci_setup : Install needed packages] ************************************** Monday 16 March 2026 14:36:05 +0000 (0:00:00.047) 0:06:21.692 ********** fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result' TASK [Create dnsmasq dir] ****************************************************** Monday 16 March 2026 14:36:41 +0000 (0:00:36.524) 0:06:58.217 ********** changed: [instance] TASK [Get journalctl in a file] ************************************************ Monday 16 March 2026 14:36:42 +0000 (0:00:00.225) 0:06:58.442 ********** changed: [instance] TASK [Dump journalctl output] ************************************************** Monday 16 March 2026 14:36:42 +0000 (0:00:00.261) 0:06:58.704 ********** changed: [instance] TASK [Copy all dnsmasq config] ************************************************* Monday 16 March 2026 14:36:42 +0000 (0:00:00.395) 0:06:59.100 ********** changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) TASK [Create log directory] **************************************************** Monday 16 March 2026 14:36:43 +0000 (0:00:00.514) 0:06:59.614 ********** changed: [instance] TASK [Sync logs from controller-0] ********************************************* Monday 16 March 2026 14:36:43 +0000 (0:00:00.201) 0:06:59.816 ********** changed: [instance] PLAY RECAP ********************************************************************* instance : ok=527 changed=202 unreachable=0 failed=1 skipped=216 rescued=0 ignored=0 Monday 16 March 2026 14:36:44 +0000 (0:00:00.850) 0:07:00.667 ********** =============================================================================== reproducer : Check package install status ------------------------------ 45.48s ci_setup : Install needed packages ------------------------------------- 36.52s libvirt_manager : Download base image ---------------------------------- 31.31s libvirt_manager : Ensure we get SSH on nodes --------------------------- 22.98s reproducer : Install collections on controller-0 ----------------------- 20.98s libvirt_manager : Install packages required for using KVM -------------- 12.72s sushy_emulator : Pull Sushy Emulator container image ------------------- 12.11s ci_nmstate : Install required packages on localhost --------------------- 8.02s sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 7.88s repo_setup : Initialize python venv and install requirements ------------ 7.65s reproducer : Ensure we have all dependencies installed ------------------ 6.00s dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.61s networking_mapper : Gather the facts ------------------------------------ 3.57s dnsmasq : Add/Remove address -------------------------------------------- 2.97s reproducer : Ensure the required parameters are loaded ------------------ 2.55s sushy_emulator : Install required packages ------------------------------ 2.55s reproducer : Clone repository if needed: architecture ------------------- 2.48s libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s dnsmasq : Add DHCP entries ---------------------------------------------- 1.95s repo_setup : Run repo-setup --------------------------------------------- 1.94s