PLAY [Prepare] *****************************************************************
TASK [Gathering Facts] *********************************************************
Monday 29 September 2025 12:34:01 +0000 (0:00:00.018) 0:00:00.018 ******
ok: [instance]
TASK [Create custom basedir] ***************************************************
Monday 29 September 2025 12:34:01 +0000 (0:00:00.798) 0:00:00.817 ******
changed: [instance]
TASK [test_deps : Gather facts if they don't exist] ****************************
Monday 29 September 2025 12:34:02 +0000 (0:00:00.294) 0:00:01.111 ******
skipping: [instance]
TASK [test_deps : Gather variables for each operating system] ******************
Monday 29 September 2025 12:34:02 +0000 (0:00:00.017) 0:00:01.129 ******
ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
TASK [test_deps : Detect mirrors file] *****************************************
Monday 29 September 2025 12:34:02 +0000 (0:00:00.041) 0:00:01.170 ******
ok: [instance]
TASK [test_deps : Disable ubi host subscription-manager integration] ***********
Monday 29 September 2025 12:34:02 +0000 (0:00:00.270) 0:00:01.440 ******
ok: [instance]
TASK [test_deps : Disable ubi 9 repos] *****************************************
Monday 29 September 2025 12:34:02 +0000 (0:00:00.203) 0:00:01.644 ******
ok: [instance] => (item=ubi-9-appstream)
ok: [instance] => (item=ubi-9-baseos)
ok: [instance] => (item=ubi-9-codeready-builder)
TASK [Deploy repo-setup] *******************************************************
Monday 29 September 2025 12:34:03 +0000 (0:00:00.668) 0:00:02.313 ******
TASK [repo_setup : Ensure directories are present] *****************************
Monday 29 September 2025 12:34:03 +0000 (0:00:00.058) 0:00:02.371 ******
changed: [instance] => (item=tmp)
changed: [instance] => (item=artifacts/repositories)
changed: [instance] => (item=venv/repo_setup)
TASK [repo_setup : Make sure git-core package is installed] ********************
Monday 29 September 2025 12:34:03 +0000 (0:00:00.521) 0:00:02.893 ******
ok: [instance]
TASK [repo_setup : Get repo-setup repository] **********************************
Monday 29 September 2025 12:34:04 +0000 (0:00:00.795) 0:00:03.689 ******
changed: [instance]
TASK [repo_setup : Initialize python venv and install requirements] ************
Monday 29 September 2025 12:34:05 +0000 (0:00:01.211) 0:00:04.900 ******
changed: [instance]
TASK [repo_setup : Install repo-setup package] *********************************
Monday 29 September 2025 12:34:13 +0000 (0:00:07.649) 0:00:12.550 ******
changed: [instance]
TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
Monday 29 September 2025 12:34:14 +0000 (0:00:00.702) 0:00:13.253 ******
skipping: [instance]
TASK [repo_setup : Run repo-setup] *********************************************
Monday 29 September 2025 12:34:14 +0000 (0:00:00.021) 0:00:13.274 ******
changed: [instance]
TASK [repo_setup : Get component repo] *****************************************
Monday 29 September 2025 12:34:15 +0000 (0:00:00.822) 0:00:14.097 ******
skipping: [instance]
TASK [repo_setup : Rename component repo] **************************************
Monday 29 September 2025 12:34:15 +0000 (0:00:00.034) 0:00:14.131 ******
skipping: [instance]
TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
Monday 29 September 2025 12:34:15 +0000 (0:00:00.034) 0:00:14.165 ******
skipping: [instance]
TASK [repo_setup : Run repo-setup-get-hash] ************************************
Monday 29 September 2025 12:34:15 +0000 (0:00:00.034) 0:00:14.200 ******
changed: [instance]
TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
Monday 29 September 2025 12:34:15 +0000 (0:00:00.550) 0:00:14.750 ******
changed: [instance]
TASK [repo_setup : Dump current-podified hash] *********************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.444) 0:00:15.195 ******
skipping: [instance]
TASK [repo_setup : Slurp current podified hash] ********************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.034) 0:00:15.230 ******
skipping: [instance]
TASK [repo_setup : Update the value of full_hash] ******************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.033) 0:00:15.264 ******
skipping: [instance]
TASK [repo_setup : Export hashes facts for further use] ************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.034) 0:00:15.298 ******
ok: [instance]
TASK [repo_setup : Create download directory] **********************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.040) 0:00:15.338 ******
skipping: [instance]
TASK [repo_setup : Print the URL to request] ***********************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.029) 0:00:15.368 ******
skipping: [instance]
TASK [Download the RPM] ********************************************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.029) 0:00:15.397 ******
skipping: [instance]
TASK [repo_setup : Install RHOS Release tool] **********************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.031) 0:00:15.429 ******
skipping: [instance]
TASK [repo_setup : Get rhos-release tool version] ******************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.039) 0:00:15.468 ******
skipping: [instance]
TASK [repo_setup : Print rhos-release tool version] ****************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.029) 0:00:15.498 ******
skipping: [instance]
TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
Monday 29 September 2025 12:34:16 +0000 (0:00:00.029) 0:00:15.527 ******
skipping: [instance]
TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.029) 0:00:15.556 ******
ok: [instance]
TASK [repo_setup : Use RDO proxy mirrors] **************************************
Monday 29 September 2025 12:34:16 +0000 (0:00:00.199) 0:00:15.756 ******
changed: [instance]
TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
Monday 29 September 2025 12:34:17 +0000 (0:00:00.223) 0:00:15.979 ******
changed: [instance]
TASK [repo_setup : Check for gating.repo file on content provider] *************
Monday 29 September 2025 12:34:17 +0000 (0:00:00.281) 0:00:16.260 ******
skipping: [instance]
TASK [repo_setup : Populate gating repo from content provider ip] **************
Monday 29 September 2025 12:34:17 +0000 (0:00:00.030) 0:00:16.290 ******
skipping: [instance]
TASK [repo_setup : Check for DLRN repo at the destination] *********************
Monday 29 September 2025 12:34:17 +0000 (0:00:00.027) 0:00:16.318 ******
skipping: [instance]
TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
Monday 29 September 2025 12:34:17 +0000 (0:00:00.031) 0:00:16.350 ******
skipping: [instance]
TASK [repo_setup : Check for DLRN component repo] ******************************
Monday 29 September 2025 12:34:17 +0000 (0:00:00.025) 0:00:16.375 ******
skipping: [instance]
TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] ***
Monday 29 September 2025 12:34:17 +0000 (0:00:00.027) 0:00:16.402 ******
skipping: [instance]
TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
Monday 29 September 2025 12:34:17 +0000 (0:00:00.026) 0:00:16.428 ******
skipping: [instance]
TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
Monday 29 September 2025 12:34:17 +0000 (0:00:00.018) 0:00:16.447 ******
skipping: [instance]
TASK [repo_setup : Cleanup existing metadata] **********************************
Monday 29 September 2025 12:34:17 +0000 (0:00:00.030) 0:00:16.478 ******
skipping: [instance]
TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
Monday 29 September 2025 12:34:17 +0000 (0:00:00.017) 0:00:16.495 ******
skipping: [instance]
TASK [test_deps : Look for redhat-release rpm] *********************************
Monday 29 September 2025 12:34:17 +0000 (0:00:00.024) 0:00:16.520 ******
skipping: [instance]
TASK [test_deps : Remove redhat-release] ***************************************
Monday 29 September 2025 12:34:17 +0000 (0:00:00.031) 0:00:16.551 ******
skipping: [instance]
TASK [test_deps : Install centos-stream-release] *******************************
Monday 29 September 2025 12:34:17 +0000 (0:00:00.032) 0:00:16.584 ******
skipping: [instance]
TASK [test_deps : Install additional packages] *********************************
Monday 29 September 2025 12:34:17 +0000 (0:00:00.033) 0:00:16.618 ******
skipping: [instance]
TASK [test_deps : Install selinux python libs] *********************************
Monday 29 September 2025 12:34:17 +0000 (0:00:00.030) 0:00:16.648 ******
ok: [instance]
TASK [test_deps : Install python yaml libs] ************************************
Monday 29 September 2025 12:35:11 +0000 (0:00:53.505) 0:01:10.153 ******
ok: [instance]
TASK [test_deps : Install extra packages] **************************************
Monday 29 September 2025 12:35:12 +0000 (0:00:01.334) 0:01:11.487 ******
skipping: [instance]
TASK [ci_setup : Gather variables for each operating system] *******************
Monday 29 September 2025 12:35:12 +0000 (0:00:00.032) 0:01:11.520 ******
ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
TASK [ci_setup : List packages to install] *************************************
Monday 29 September 2025 12:35:12 +0000 (0:00:00.046) 0:01:11.566 ******
ok: [instance] =>
cifmw_ci_setup_packages:
- bash-completion
- ca-certificates
- git-core
- make
- tar
- tmux
- python3-pip
TASK [ci_setup : Install needed packages] **************************************
Monday 29 September 2025 12:35:12 +0000 (0:00:00.022) 0:01:11.589 ******
changed: [instance]
TASK [ci_setup : Gather version of openshift client] ***************************
Monday 29 September 2025 12:35:18 +0000 (0:00:05.938) 0:01:17.527 ******
ok: [instance]
TASK [ci_setup : Ensure openshift client install path is present] **************
Monday 29 September 2025 12:35:19 +0000 (0:00:00.613) 0:01:18.140 ******
changed: [instance]
TASK [ci_setup : Install openshift client] *************************************
Monday 29 September 2025 12:35:19 +0000 (0:00:00.234) 0:01:18.374 ******
changed: [instance]
TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
Monday 29 September 2025 12:35:26 +0000 (0:00:07.072) 0:01:25.447 ******
ok: [instance]
TASK [ci_setup : Create completion file] ***************************************
Monday 29 September 2025 12:35:26 +0000 (0:00:00.038) 0:01:25.486 ******
changed: [instance]
TASK [ci_setup : Source completion from within .bashrc] ************************
Monday 29 September 2025 12:35:26 +0000 (0:00:00.263) 0:01:25.750 ******
changed: [instance]
TASK [ci_setup : Check rhsm status] ********************************************
Monday 29 September 2025 12:35:27 +0000 (0:00:00.275) 0:01:26.025 ******
skipping: [instance]
TASK [ci_setup : Gather the repos to be enabled] *******************************
Monday 29 September 2025 12:35:27 +0000 (0:00:00.018) 0:01:26.044 ******
skipping: [instance]
TASK [ci_setup : Enabling the required repositories.] **************************
Monday 29 September 2025 12:35:27 +0000 (0:00:00.018) 0:01:26.062 ******
skipping: [instance]
TASK [ci_setup : Get current /etc/redhat-release] ******************************
Monday 29 September 2025 12:35:27 +0000 (0:00:00.017) 0:01:26.080 ******
skipping: [instance]
TASK [ci_setup : Print current /etc/redhat-release] ****************************
Monday 29 September 2025 12:35:27 +0000 (0:00:00.015) 0:01:26.096 ******
skipping: [instance]
TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
Monday 29 September 2025 12:35:27 +0000 (0:00:00.016) 0:01:26.113 ******
skipping: [instance]
TASK [ci_setup : Manage directories] *******************************************
Monday 29 September 2025 12:35:27 +0000 (0:00:00.021) 0:01:26.134 ******
changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
changed: [instance] => (item=/opt/basedir/logs)
ok: [instance] => (item=/opt/basedir/tmp)
changed: [instance] => (item=/opt/basedir/volumes)
changed: [instance] => (item=/opt/basedir/artifacts/parameters)
TASK [Create secret file] ******************************************************
Monday 29 September 2025 12:35:28 +0000 (0:00:00.969) 0:01:27.103 ******
changed: [instance]
PLAY RECAP *********************************************************************
instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0
Monday 29 September 2025 12:35:28 +0000 (0:00:00.345) 0:01:27.449 ******
===============================================================================
test_deps : Install selinux python libs -------------------------------- 53.51s
repo_setup : Initialize python venv and install requirements ------------ 7.65s
ci_setup : Install openshift client ------------------------------------- 7.07s
ci_setup : Install needed packages -------------------------------------- 5.94s
test_deps : Install python yaml libs ------------------------------------ 1.33s
repo_setup : Get repo-setup repository ---------------------------------- 1.21s
ci_setup : Manage directories ------------------------------------------- 0.97s
repo_setup : Run repo-setup --------------------------------------------- 0.82s
Gathering Facts --------------------------------------------------------- 0.80s
repo_setup : Make sure git-core package is installed -------------------- 0.80s
repo_setup : Install repo-setup package --------------------------------- 0.70s
test_deps : Disable ubi 9 repos ----------------------------------------- 0.67s
ci_setup : Gather version of openshift client --------------------------- 0.61s
repo_setup : Run repo-setup-get-hash ------------------------------------ 0.55s
repo_setup : Ensure directories are present ----------------------------- 0.52s
repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.44s
Create secret file ------------------------------------------------------ 0.35s
Create custom basedir --------------------------------------------------- 0.29s
repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist) --- 0.28s
ci_setup : Source completion from within .bashrc ------------------------ 0.28s
PLAY [Converge] ****************************************************************
TASK [Gathering Facts] *********************************************************
Monday 29 September 2025 12:35:29 +0000 (0:00:00.023) 0:00:00.023 ******
ok: [instance]
TASK [Load networking definition from scenario file] ***************************
Monday 29 September 2025 12:35:29 +0000 (0:00:00.809) 0:00:00.833 ******
ok: [instance]
TASK [discover_latest_image : Get latest image] ********************************
Monday 29 September 2025 12:35:30 +0000 (0:00:00.049) 0:00:00.882 ******
changed: [instance]
TASK [discover_latest_image : Export facts accordingly] ************************
Monday 29 September 2025 12:35:31 +0000 (0:00:01.575) 0:00:02.457 ******
ok: [instance]
TASK [reproducer : Load CI job environment] ************************************
Monday 29 September 2025 12:35:31 +0000 (0:00:00.028) 0:00:02.486 ******
skipping: [instance]
TASK [reproducer : Discover and expose CI Framework path on remote node] *******
Monday 29 September 2025 12:35:31 +0000 (0:00:00.022) 0:00:02.509 ******
ok: [instance]
TASK [Build final libvirt layout] **********************************************
Monday 29 September 2025 12:35:31 +0000 (0:00:00.045) 0:00:02.554 ******
TASK [libvirt_manager : Chose right parameter for layout definition] ***********
Monday 29 September 2025 12:35:31 +0000 (0:00:00.050) 0:00:02.605 ******
ok: [instance]
TASK [libvirt_manager : Patch the layout if needed] ****************************
Monday 29 September 2025 12:35:31 +0000 (0:00:00.081) 0:00:02.686 ******
skipping: [instance]
TASK [reproducer : Set controller-0 user and basedir facts] ********************
Monday 29 September 2025 12:35:31 +0000 (0:00:00.060) 0:00:02.747 ******
ok: [instance]
TASK [reproducer : Assert no conflicting parameters were passed] ***************
Monday 29 September 2025 12:35:31 +0000 (0:00:00.039) 0:00:02.787 ******
ok: [instance]
TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
Monday 29 September 2025 12:35:31 +0000 (0:00:00.028) 0:00:02.816 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [reproducer : Set _use_crc based on actual layout] ************************
Monday 29 September 2025 12:35:31 +0000 (0:00:00.024) 0:00:02.841 ******
ok: [instance]
TASK [reproducer : Ensure directories are present] *****************************
Monday 29 September 2025 12:35:32 +0000 (0:00:00.043) 0:00:02.884 ******
ok: [instance] => (item=artifacts)
ok: [instance] => (item=logs)
TASK [Bootstrap libvirt if needed] *********************************************
Monday 29 September 2025 12:35:32 +0000 (0:00:00.471) 0:00:03.356 ******
TASK [libvirt_manager : Ensure output directory exists] ************************
Monday 29 September 2025 12:35:32 +0000 (0:00:00.077) 0:00:03.434 ******
ok: [instance]
TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
Monday 29 September 2025 12:35:32 +0000 (0:00:00.201) 0:00:03.635 ******
changed: [instance]
TASK [libvirt_manager : Check if KVM is enabled] *******************************
Monday 29 September 2025 12:35:33 +0000 (0:00:00.292) 0:00:03.928 ******
ok: [instance]
TASK [libvirt_manager : Fail if KVM not enabled] *******************************
Monday 29 September 2025 12:35:33 +0000 (0:00:00.287) 0:00:04.215 ******
skipping: [instance]
TASK [libvirt_manager : Check if VMX virtualization] ***************************
Monday 29 September 2025 12:35:33 +0000 (0:00:00.031) 0:00:04.246 ******
skipping: [instance]
TASK [libvirt_manager : Check if SVM virtualization] ***************************
Monday 29 September 2025 12:35:33 +0000 (0:00:00.019) 0:00:04.266 ******
ok: [instance]
TASK [libvirt_manager : Enable VMX virtualization] *****************************
Monday 29 September 2025 12:35:33 +0000 (0:00:00.021) 0:00:04.288 ******
skipping: [instance]
TASK [libvirt_manager : Install packages required for using KVM] ***************
Monday 29 September 2025 12:35:33 +0000 (0:00:00.028) 0:00:04.316 ******
changed: [instance]
TASK [libvirt_manager : Create rules.d polkit folder] **************************
Monday 29 September 2025 12:35:43 +0000 (0:00:10.008) 0:00:14.325 ******
changed: [instance]
TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
Monday 29 September 2025 12:35:43 +0000 (0:00:00.214) 0:00:14.540 ******
changed: [instance]
TASK [libvirt_manager : Restart service polkit service] ************************
Monday 29 September 2025 12:35:44 +0000 (0:00:00.495) 0:00:15.035 ******
changed: [instance]
TASK [libvirt_manager : Remove directory for service override] *****************
Monday 29 September 2025 12:35:44 +0000 (0:00:00.591) 0:00:15.626 ******
ok: [instance]
TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
Monday 29 September 2025 12:35:44 +0000 (0:00:00.194) 0:00:15.821 ******
ok: [instance]
TASK [libvirt_manager : Ensure firewalld service is up] ************************
Monday 29 September 2025 12:35:45 +0000 (0:00:00.654) 0:00:16.476 ******
changed: [instance]
TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
Monday 29 September 2025 12:35:46 +0000 (0:00:00.941) 0:00:17.417 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
Monday 29 September 2025 12:35:46 +0000 (0:00:00.086) 0:00:17.504 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
Monday 29 September 2025 12:35:46 +0000 (0:00:00.316) 0:00:17.820 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
Monday 29 September 2025 12:35:47 +0000 (0:00:00.319) 0:00:18.140 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
Monday 29 September 2025 12:35:47 +0000 (0:00:00.317) 0:00:18.458 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
Monday 29 September 2025 12:35:47 +0000 (0:00:00.317) 0:00:18.776 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
Monday 29 September 2025 12:35:48 +0000 (0:00:00.321) 0:00:19.097 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
Monday 29 September 2025 12:35:48 +0000 (0:00:00.312) 0:00:19.410 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
Monday 29 September 2025 12:35:48 +0000 (0:00:00.319) 0:00:19.729 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
Monday 29 September 2025 12:35:49 +0000 (0:00:00.328) 0:00:20.058 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
Monday 29 September 2025 12:35:49 +0000 (0:00:00.326) 0:00:20.385 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
Monday 29 September 2025 12:35:49 +0000 (0:00:00.320) 0:00:20.705 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
Monday 29 September 2025 12:35:50 +0000 (0:00:00.317) 0:00:21.022 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
Monday 29 September 2025 12:35:50 +0000 (0:00:00.319) 0:00:21.342 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
Monday 29 September 2025 12:35:50 +0000 (0:00:00.301) 0:00:21.643 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
Monday 29 September 2025 12:35:51 +0000 (0:00:00.315) 0:00:21.959 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
Monday 29 September 2025 12:35:51 +0000 (0:00:00.321) 0:00:22.280 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
Monday 29 September 2025 12:35:51 +0000 (0:00:00.311) 0:00:22.592 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
Monday 29 September 2025 12:35:52 +0000 (0:00:00.319) 0:00:22.912 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
Monday 29 September 2025 12:35:52 +0000 (0:00:00.323) 0:00:23.236 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
Monday 29 September 2025 12:35:52 +0000 (0:00:00.309) 0:00:23.545 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
Monday 29 September 2025 12:35:52 +0000 (0:00:00.312) 0:00:23.857 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
Monday 29 September 2025 12:35:53 +0000 (0:00:00.309) 0:00:24.167 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
Monday 29 September 2025 12:35:53 +0000 (0:00:00.307) 0:00:24.475 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
Monday 29 September 2025 12:35:53 +0000 (0:00:00.321) 0:00:24.796 ******
ok: [instance]
TASK [libvirt_manager : Manage service for older releases] *********************
Monday 29 September 2025 12:35:54 +0000 (0:00:00.305) 0:00:25.101 ******
skipping: [instance]
TASK [libvirt_manager : Get libvirt group users] *******************************
Monday 29 September 2025 12:35:54 +0000 (0:00:00.021) 0:00:25.122 ******
ok: [instance]
TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
Monday 29 September 2025 12:35:54 +0000 (0:00:00.284) 0:00:25.407 ******
ok: [instance]
TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
Monday 29 September 2025 12:35:54 +0000 (0:00:00.369) 0:00:25.777 ******
changed: [instance]
TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
Monday 29 September 2025 12:35:55 +0000 (0:00:00.306) 0:00:26.084 ******
[WARNING]: Reset is not implemented for this connection
changed: [instance]
TASK [libvirt_manager : Ensure we reload user env] *****************************
Monday 29 September 2025 12:35:55 +0000 (0:00:00.284) 0:00:26.368 ******
TASK [reproducer : Deploy networks in libvirt] *********************************
Monday 29 September 2025 12:35:55 +0000 (0:00:00.015) 0:00:26.384 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
TASK [reproducer : Ensure networks are consistent] *****************************
Monday 29 September 2025 12:35:55 +0000 (0:00:00.091) 0:00:26.475 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
TASK [reproducer : Ensure all VM types have defined nets parameter] ************
Monday 29 September 2025 12:35:55 +0000 (0:00:00.041) 0:00:26.517 ******
ok: [instance] => (item=compute)
ok: [instance] => (item=controller)
ok: [instance] => (item=crc)
TASK [reproducer : Ensure all standard attached networks are defined] **********
Monday 29 September 2025 12:35:55 +0000 (0:00:00.047) 0:00:26.564 ******
ok: [instance]
TASK [reproducer : Ensure we don't have extra network defined] *****************
Monday 29 September 2025 12:35:55 +0000 (0:00:00.041) 0:00:26.606 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [Ensure we get latest OCP config] *****************************************
Monday 29 September 2025 12:35:55 +0000 (0:00:00.044) 0:00:26.650 ******
TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
Monday 29 September 2025 12:35:55 +0000 (0:00:00.043) 0:00:26.694 ******
ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
ok: [instance] => (item={})
TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
Monday 29 September 2025 12:35:55 +0000 (0:00:00.071) 0:00:26.765 ******
skipping: [instance]
TASK [devscripts : Ensure output directory exists] *****************************
Monday 29 September 2025 12:35:55 +0000 (0:00:00.017) 0:00:26.782 ******
ok: [instance]
TASK [devscripts : Output built config for easier debugging] *******************
Monday 29 September 2025 12:35:56 +0000 (0:00:00.212) 0:00:26.995 ******
changed: [instance]
TASK [ci_network : Remove the local dns configuration] *************************
Monday 29 September 2025 12:35:56 +0000 (0:00:00.362) 0:00:27.357 ******
ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
TASK [ci_network : Reload the NetworkManager to pick the changes] **************
Monday 29 September 2025 12:35:57 +0000 (0:00:00.759) 0:00:28.117 ******
skipping: [instance]
TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
Monday 29 September 2025 12:35:57 +0000 (0:00:00.027) 0:00:28.145 ******
changed: [instance]
TASK [reproducer : Flush handlers for NetworkManager restart] ******************
Monday 29 September 2025 12:35:57 +0000 (0:00:00.399) 0:00:28.544 ******
RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
Monday 29 September 2025 12:35:57 +0000 (0:00:00.008) 0:00:28.552 ******
changed: [instance]
TASK [Ensure no default networks exists] ***************************************
Monday 29 September 2025 12:35:58 +0000 (0:00:00.436) 0:00:28.989 ******
TASK [libvirt_manager : Deactivate crc] ****************************************
Monday 29 September 2025 12:35:58 +0000 (0:00:00.079) 0:00:29.068 ******
ok: [instance]
TASK [libvirt_manager : Removing crc] ******************************************
Monday 29 September 2025 12:35:59 +0000 (0:00:01.183) 0:00:30.251 ******
ok: [instance]
TASK [libvirt_manager : Deactivate default] ************************************
Monday 29 September 2025 12:35:59 +0000 (0:00:00.227) 0:00:30.478 ******
ok: [instance]
TASK [libvirt_manager : Removing default] **************************************
Monday 29 September 2025 12:36:00 +0000 (0:00:00.516) 0:00:30.995 ******
ok: [instance]
TASK [reproducer : Ensure firewalld is installed] ******************************
Monday 29 September 2025 12:36:00 +0000 (0:00:00.219) 0:00:31.214 ******
ok: [instance]
TASK [reproducer : Ensure firewalld service is enabled and started] ************
Monday 29 September 2025 12:36:01 +0000 (0:00:01.148) 0:00:32.362 ******
ok: [instance]
TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
Monday 29 September 2025 12:36:01 +0000 (0:00:00.313) 0:00:32.676 ******
changed: [instance]
TASK [reproducer : Ensure IP forwarding is enabled] ****************************
Monday 29 September 2025 12:36:02 +0000 (0:00:00.299) 0:00:32.975 ******
changed: [instance]
TASK [reproducer : Ensure the required parameters are loaded] ******************
Monday 29 September 2025 12:36:02 +0000 (0:00:00.295) 0:00:33.271 ******
changed: [instance] => (item=arptables)
changed: [instance] => (item=iptables)
changed: [instance] => (item=ip6tables)
TASK [reproducer : Ensure firewall service is enabled and started] *************
Monday 29 September 2025 12:36:02 +0000 (0:00:00.564) 0:00:33.835 ******
ok: [instance]
TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
Monday 29 September 2025 12:36:03 +0000 (0:00:00.311) 0:00:34.147 ******
ok: [instance]
TASK [Ensure the required network configurations are applied] ******************
Monday 29 September 2025 12:36:03 +0000 (0:00:00.092) 0:00:34.239 ******
TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
Monday 29 September 2025 12:36:03 +0000 (0:00:00.041) 0:00:34.281 ******
skipping: [instance]
TASK [networking_mapper : Check for Networking Definition file existance] ******
Monday 29 September 2025 12:36:03 +0000 (0:00:00.021) 0:00:34.302 ******
skipping: [instance]
TASK [networking_mapper : Load the Networking Definition from file] ************
Monday 29 September 2025 12:36:03 +0000 (0:00:00.022) 0:00:34.324 ******
skipping: [instance]
TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
Monday 29 September 2025 12:36:03 +0000 (0:00:00.023) 0:00:34.348 ******
skipping: [instance]
TASK [ci_nmstate : Initialize NMstates for each instance] **********************
Monday 29 September 2025 12:36:03 +0000 (0:00:00.027) 0:00:34.375 ******
ok: [instance]
TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
Monday 29 September 2025 12:36:03 +0000 (0:00:00.037) 0:00:34.413 ******
skipping: [instance]
TASK [ci_nmstate : Get k8s nodes] **********************************************
Monday 29 September 2025 12:36:03 +0000 (0:00:00.032) 0:00:34.446 ******
skipping: [instance]
TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
Monday 29 September 2025 12:36:03 +0000 (0:00:00.025) 0:00:34.471 ******
ok: [instance]
TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
Monday 29 September 2025 12:36:03 +0000 (0:00:00.053) 0:00:34.525 ******
skipping: [instance]
TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
Monday 29 September 2025 12:36:03 +0000 (0:00:00.020) 0:00:34.546 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
TASK [ci_nmstate : Ensure we have needed facts] ********************************
Monday 29 September 2025 12:36:03 +0000 (0:00:00.043) 0:00:34.589 ******
ok: [instance -> localhost]
TASK [ci_nmstate : Install required packages on localhost] *********************
Monday 29 September 2025 12:36:04 +0000 (0:00:00.318) 0:00:34.908 ******
changed: [instance -> localhost]
TASK [ci_nmstate : Create the target NMstate dump directory] *******************
Monday 29 September 2025 12:36:11 +0000 (0:00:07.655) 0:00:42.563 ******
changed: [instance]
TASK [ci_nmstate : Save nmstate state for localhost] ***************************
Monday 29 September 2025 12:36:11 +0000 (0:00:00.205) 0:00:42.769 ******
changed: [instance]
TASK [ci_nmstate : Apply the desidered state on localhost] *********************
Monday 29 September 2025 12:36:12 +0000 (0:00:00.329) 0:00:43.098 ******
changed: [instance -> localhost]
TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
Monday 29 September 2025 12:36:13 +0000 (0:00:01.620) 0:00:44.719 ******
changed: [instance]
TASK [reproducer : Select right domain] ****************************************
Monday 29 September 2025 12:36:14 +0000 (0:00:00.335) 0:00:45.054 ******
ok: [instance]
TASK [Create the virtual networks] *********************************************
Monday 29 September 2025 12:36:14 +0000 (0:00:00.030) 0:00:45.085 ******
TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
Monday 29 September 2025 12:36:14 +0000 (0:00:00.110) 0:00:45.196 ******
ok: [instance]
TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
Monday 29 September 2025 12:36:14 +0000 (0:00:00.019) 0:00:45.215 ******
ok: [instance]
TASK [libvirt_manager : Load file if exists] ***********************************
Monday 29 September 2025 12:36:14 +0000 (0:00:00.188) 0:00:45.403 ******
skipping: [instance]
TASK [libvirt_manager : Update fact with existing content] *********************
Monday 29 September 2025 12:36:14 +0000 (0:00:00.028) 0:00:45.431 ******
skipping: [instance]
TASK [libvirt_manager : Generate VM list] **************************************
Monday 29 September 2025 12:36:14 +0000 (0:00:00.027) 0:00:45.459 ******
ok: [instance]
TASK [libvirt_manager : Generate/update mapping all nodes] *********************
Monday 29 September 2025 12:36:14 +0000 (0:00:00.053) 0:00:45.513 ******
ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
TASK [libvirt_manager : Append baremetal nodes if needed] **********************
Monday 29 September 2025 12:36:14 +0000 (0:00:00.125) 0:00:45.638 ******
skipping: [instance]
TASK [libvirt_manager : Dump MAC mapping] **************************************
Monday 29 September 2025 12:36:14 +0000 (0:00:00.072) 0:00:45.710 ******
changed: [instance]
TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
Monday 29 September 2025 12:36:15 +0000 (0:00:00.348) 0:00:46.059 ******
changed: [instance] => (item=Adding compute-0 to computes)
changed: [instance] => (item=Adding controller-0 to controllers)
changed: [instance] => (item=Adding crc-0 to ocps)
TASK [networking_mapper : Check for Networking Definition file existence] ******
Monday 29 September 2025 12:36:15 +0000 (0:00:00.119) 0:00:46.179 ******
skipping: [instance]
TASK [networking_mapper : Load the Networking Definition from file] ************
Monday 29 September 2025 12:36:15 +0000 (0:00:00.023) 0:00:46.203 ******
skipping: [instance]
TASK [networking_mapper : Check for interfaces info file existence] ************
Monday 29 September 2025 12:36:15 +0000 (0:00:00.023) 0:00:46.226 ******
skipping: [instance]
TASK [networking_mapper : Load the interfaces info from file] ******************
Monday 29 September 2025 12:36:15 +0000 (0:00:00.023) 0:00:46.249 ******
skipping: [instance]
TASK [networking_mapper : Ensure local fact is empty] **************************
Monday 29 September 2025 12:36:15 +0000 (0:00:00.025) 0:00:46.275 ******
ok: [instance]
TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
Monday 29 September 2025 12:36:15 +0000 (0:00:00.018) 0:00:46.294 ******
ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
TASK [networking_mapper : Gather facts if requested] ***************************
Monday 29 September 2025 12:36:15 +0000 (0:00:00.075) 0:00:46.369 ******
skipping: [instance]
TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
Monday 29 September 2025 12:36:15 +0000 (0:00:00.017) 0:00:46.386 ******
changed: [instance]
TASK [networking_mapper : Write the Networking Definition to file] *************
Monday 29 September 2025 12:36:15 +0000 (0:00:00.198) 0:00:46.585 ******
changed: [instance]
TASK [networking_mapper : Call the networking mapper] **************************
Monday 29 September 2025 12:36:16 +0000 (0:00:00.387) 0:00:46.972 ******
ok: [instance]
TASK [networking_mapper : Set networking mapper facts] *************************
Monday 29 September 2025 12:36:16 +0000 (0:00:00.058) 0:00:47.030 ******
ok: [instance]
TASK [networking_mapper : Write the Networking Environment Definition to file] ***
Monday 29 September 2025 12:36:16 +0000 (0:00:00.030) 0:00:47.061 ******
changed: [instance]
TASK [libvirt_manager : Manage networks if needed] *****************************
Monday 29 September 2025 12:36:16 +0000 (0:00:00.375) 0:00:47.436 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
Monday 29 September 2025 12:36:16 +0000 (0:00:00.073) 0:00:47.509 ******
ok: [instance] => (item=public)
ok: [instance] => (item=osp_trunk)
TASK [libvirt_manager : Ensure networks are defined] ***************************
Monday 29 September 2025 12:36:16 +0000 (0:00:00.045) 0:00:47.555 ******
changed: [instance] => (item=cifmw-public)
changed: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Ensure networks are created/started] *******************
Monday 29 September 2025 12:36:17 +0000 (0:00:00.428) 0:00:47.984 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Ensure networks are active] ****************************
Monday 29 September 2025 12:36:17 +0000 (0:00:00.602) 0:00:48.586 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
Monday 29 September 2025 12:36:18 +0000 (0:00:00.433) 0:00:49.020 ******
changed: [instance] => (item=cifmw-public)
changed: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
Monday 29 September 2025 12:36:18 +0000 (0:00:00.436) 0:00:49.457 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
Monday 29 September 2025 12:36:18 +0000 (0:00:00.056) 0:00:49.513 ******
ok: [instance]
TASK [libvirt_manager : Fetch bridges ports link info] *************************
Monday 29 September 2025 12:36:18 +0000 (0:00:00.183) 0:00:49.697 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [Create dummy interfaces to ensure bridges are UP] ************************
Monday 29 September 2025 12:36:19 +0000 (0:00:00.402) 0:00:50.100 ******
TASK [ci_nmstate : Ensure we have needed facts] ********************************
Monday 29 September 2025 12:36:19 +0000 (0:00:00.072) 0:00:50.172 ******
skipping: [instance]
TASK [ci_nmstate : Install required packages on instance] **********************
Monday 29 September 2025 12:36:19 +0000 (0:00:00.041) 0:00:50.214 ******
ok: [instance]
TASK [ci_nmstate : Create the target NMstate dump directory] *******************
Monday 29 September 2025 12:36:20 +0000 (0:00:01.212) 0:00:51.426 ******
ok: [instance]
TASK [ci_nmstate : Save nmstate state for instance] ****************************
Monday 29 September 2025 12:36:20 +0000 (0:00:00.208) 0:00:51.634 ******
changed: [instance]
TASK [ci_nmstate : Apply the desidered state on instance] **********************
Monday 29 September 2025 12:36:21 +0000 (0:00:00.406) 0:00:52.041 ******
changed: [instance]
TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
Monday 29 September 2025 12:36:22 +0000 (0:00:01.652) 0:00:53.694 ******
changed: [instance]
TASK [Create extra network configuration] **************************************
Monday 29 September 2025 12:36:23 +0000 (0:00:00.385) 0:00:54.079 ******
skipping: [instance]
TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
Monday 29 September 2025 12:36:23 +0000 (0:00:00.038) 0:00:54.118 ******
skipping: [instance]
TASK [libvirt_manager : Refresh networking facts on host] **********************
Monday 29 September 2025 12:36:23 +0000 (0:00:00.029) 0:00:54.148 ******
ok: [instance]
TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
Monday 29 September 2025 12:36:23 +0000 (0:00:00.461) 0:00:54.610 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [dnsmasq : Install needed packages] ***************************************
Monday 29 September 2025 12:36:23 +0000 (0:00:00.148) 0:00:54.758 ******
ok: [instance]
TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
Monday 29 September 2025 12:36:25 +0000 (0:00:01.156) 0:00:55.915 ******
changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
TASK [dnsmasq : Manage configuration directory] ********************************
Monday 29 September 2025 12:36:28 +0000 (0:00:03.792) 0:00:59.707 ******
changed: [instance]
TASK [dnsmasq : Manage systemd unit file] **************************************
Monday 29 September 2025 12:36:29 +0000 (0:00:00.233) 0:00:59.941 ******
changed: [instance]
TASK [dnsmasq : Manage base configuration file] ********************************
Monday 29 September 2025 12:36:29 +0000 (0:00:00.380) 0:01:00.322 ******
changed: [instance]
TASK [dnsmasq : Render listener configuration] *********************************
Monday 29 September 2025 12:36:29 +0000 (0:00:00.421) 0:01:00.744 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
TASK [dnsmasq : Create listener configuration file] ****************************
Monday 29 September 2025 12:36:29 +0000 (0:00:00.032) 0:01:00.776 ******
changed: [instance]
TASK [dnsmasq : Remove listener configuration file] ****************************
Monday 29 September 2025 12:36:30 +0000 (0:00:00.420) 0:01:01.197 ******
skipping: [instance]
TASK [dnsmasq : Render dns configuration] **************************************
Monday 29 September 2025 12:36:30 +0000 (0:00:00.020) 0:01:01.217 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
TASK [dnsmasq : Create dns configuration file] *********************************
Monday 29 September 2025 12:36:30 +0000 (0:00:00.034) 0:01:01.252 ******
changed: [instance]
TASK [dnsmasq : Remove dns configuration file] *********************************
Monday 29 September 2025 12:36:30 +0000 (0:00:00.384) 0:01:01.637 ******
skipping: [instance]
TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
Monday 29 September 2025 12:36:30 +0000 (0:00:00.019) 0:01:01.656 ******
ok: [instance] => (item=127.0.0.2)
TASK [dnsmasq : Enable and start service] **************************************
Monday 29 September 2025 12:36:30 +0000 (0:00:00.214) 0:01:01.871 ******
changed: [instance]
TASK [dnsmasq : Stop service] **************************************************
Monday 29 September 2025 12:36:31 +0000 (0:00:00.695) 0:01:02.567 ******
skipping: [instance]
TASK [dnsmasq : Remove unit file] **********************************************
Monday 29 September 2025 12:36:31 +0000 (0:00:00.019) 0:01:02.586 ******
skipping: [instance]
TASK [dnsmasq : Remove main configuration files] *******************************
Monday 29 September 2025 12:36:31 +0000 (0:00:00.018) 0:01:02.604 ******
skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
skipping: [instance]
TASK [Create dnsmasq networks] *************************************************
Monday 29 September 2025 12:36:31 +0000 (0:00:00.030) 0:01:02.634 ******
TASK [dnsmasq : Assert mandatory parameter] ************************************
Monday 29 September 2025 12:36:31 +0000 (0:00:00.117) 0:01:02.752 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [dnsmasq : Assert mandatory parameters for new network] *******************
Monday 29 September 2025 12:36:31 +0000 (0:00:00.035) 0:01:02.787 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [dnsmasq : Create network] ************************************************
Monday 29 September 2025 12:36:31 +0000 (0:00:00.048) 0:01:02.836 ******
changed: [instance]
TASK [dnsmasq : Remove network] ************************************************
Monday 29 September 2025 12:36:32 +0000 (0:00:00.477) 0:01:03.313 ******
skipping: [instance]
TASK [dnsmasq : Remove dhcp host files] ****************************************
Monday 29 September 2025 12:36:32 +0000 (0:00:00.021) 0:01:03.334 ******
skipping: [instance]
TASK [dnsmasq : Assert mandatory parameter] ************************************
Monday 29 September 2025 12:36:32 +0000 (0:00:00.023) 0:01:03.358 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [dnsmasq : Assert mandatory parameters for new network] *******************
Monday 29 September 2025 12:36:32 +0000 (0:00:00.028) 0:01:03.387 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [dnsmasq : Create network] ************************************************
Monday 29 September 2025 12:36:32 +0000 (0:00:00.037) 0:01:03.425 ******
changed: [instance]
TASK [dnsmasq : Remove network] ************************************************
Monday 29 September 2025 12:36:33 +0000 (0:00:00.474) 0:01:03.899 ******
skipping: [instance]
TASK [dnsmasq : Remove dhcp host files] ****************************************
Monday 29 September 2025 12:36:33 +0000 (0:00:00.019) 0:01:03.919 ******
skipping: [instance]
TASK [libvirt_manager : Ensure network is in correct zone] *********************
Monday 29 September 2025 12:36:33 +0000 (0:00:00.024) 0:01:03.943 ******
changed: [instance] => (item=cifmw-public)
changed: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Extract IP address from network bridges] ***************
Monday 29 September 2025 12:36:33 +0000 (0:00:00.536) 0:01:04.479 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Extract IP address from network bridges] ***************
Monday 29 September 2025 12:36:33 +0000 (0:00:00.051) 0:01:04.531 ******
ok: [instance]
TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
Monday 29 September 2025 12:36:33 +0000 (0:00:00.313) 0:01:04.844 ******
ok: [instance]
TASK [libvirt_manager : Extract IP address from network bridges] ***************
Monday 29 September 2025 12:36:34 +0000 (0:00:00.042) 0:01:04.887 ******
ok: [instance]
TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
Monday 29 September 2025 12:36:34 +0000 (0:00:00.207) 0:01:05.094 ******
ok: [instance]
TASK [libvirt_manager : Output _network_data] **********************************
Monday 29 September 2025 12:36:34 +0000 (0:00:00.042) 0:01:05.136 ******
changed: [instance]
TASK [libvirt_manager : Output pub_net] ****************************************
Monday 29 September 2025 12:36:34 +0000 (0:00:00.342) 0:01:05.479 ******
changed: [instance]
TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
Monday 29 September 2025 12:36:34 +0000 (0:00:00.336) 0:01:05.815 ******
changed: [instance]
TASK [libvirt_manager : Expose patch for networking_mapper] ********************
Monday 29 September 2025 12:36:35 +0000 (0:00:00.342) 0:01:06.158 ******
ok: [instance]
TASK [libvirt_manager : Save networking_mapper patch] **************************
Monday 29 September 2025 12:36:35 +0000 (0:00:00.098) 0:01:06.256 ******
changed: [instance]
TASK [networking_mapper : Check for Networking Definition file existence] ******
Monday 29 September 2025 12:36:35 +0000 (0:00:00.340) 0:01:06.597 ******
skipping: [instance]
TASK [networking_mapper : Load the Networking Definition from file] ************
Monday 29 September 2025 12:36:35 +0000 (0:00:00.027) 0:01:06.624 ******
skipping: [instance]
TASK [networking_mapper : Check for interfaces info file existence] ************
Monday 29 September 2025 12:36:35 +0000 (0:00:00.026) 0:01:06.651 ******
skipping: [instance]
TASK [networking_mapper : Load the interfaces info from file] ******************
Monday 29 September 2025 12:36:35 +0000 (0:00:00.025) 0:01:06.676 ******
skipping: [instance]
TASK [networking_mapper : Ensure local fact is empty] **************************
Monday 29 September 2025 12:36:35 +0000 (0:00:00.026) 0:01:06.703 ******
ok: [instance]
TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
Monday 29 September 2025 12:36:35 +0000 (0:00:00.019) 0:01:06.722 ******
ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
TASK [networking_mapper : Gather facts if requested] ***************************
Monday 29 September 2025 12:36:35 +0000 (0:00:00.084) 0:01:06.807 ******
skipping: [instance]
TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
Monday 29 September 2025 12:36:35 +0000 (0:00:00.019) 0:01:06.826 ******
ok: [instance]
TASK [networking_mapper : Write the Networking Definition to file] *************
Monday 29 September 2025 12:36:36 +0000 (0:00:00.198) 0:01:07.024 ******
changed: [instance]
TASK [networking_mapper : Call the networking mapper] **************************
Monday 29 September 2025 12:36:36 +0000 (0:00:00.399) 0:01:07.424 ******
ok: [instance]
TASK [networking_mapper : Set networking mapper facts] *************************
Monday 29 September 2025 12:36:36 +0000 (0:00:00.061) 0:01:07.486 ******
ok: [instance]
TASK [networking_mapper : Write the Networking Environment Definition to file] ***
Monday 29 September 2025 12:36:36 +0000 (0:00:00.041) 0:01:07.527 ******
changed: [instance]
TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
Monday 29 September 2025 12:36:37 +0000 (0:00:00.418) 0:01:07.945 ******
ok: [instance]
TASK [libvirt_manager : Unset patch] *******************************************
Monday 29 September 2025 12:36:37 +0000 (0:00:00.033) 0:01:07.979 ******
ok: [instance]
TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
Monday 29 September 2025 12:36:37 +0000 (0:00:00.020) 0:01:07.999 ******
ok: [instance]
TASK [libvirt_manager : Reserve IPs on networks] *******************************
Monday 29 September 2025 12:36:37 +0000 (0:00:00.021) 0:01:08.021 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
TASK [libvirt_manager : Loop on host IPs] **************************************
Monday 29 September 2025 12:36:37 +0000 (0:00:00.074) 0:01:08.095 ******
ok: [instance] => (item=compute-0 - ctlplane)
ok: [instance] => (item=controller-0 - ctlplane)
ok: [instance] => (item=crc-0 - ctlplane)
TASK [libvirt_manager : Loop on host IPs] **************************************
Monday 29 September 2025 12:36:37 +0000 (0:00:00.119) 0:01:08.215 ******
skipping: [instance] => (item=compute-0 - internalapi)
skipping: [instance] => (item=controller-0 - internalapi)
skipping: [instance] => (item=crc-0 - internalapi)
skipping: [instance]
TASK [libvirt_manager : Loop on host IPs] **************************************
Monday 29 September 2025 12:36:37 +0000 (0:00:00.098) 0:01:08.313 ******
skipping: [instance] => (item=compute-0 - storage)
skipping: [instance] => (item=controller-0 - storage)
skipping: [instance] => (item=crc-0 - storage)
skipping: [instance]
TASK [libvirt_manager : Loop on host IPs] **************************************
Monday 29 September 2025 12:36:37 +0000 (0:00:00.080) 0:01:08.394 ******
skipping: [instance] => (item=compute-0 - tenant)
skipping: [instance] => (item=controller-0 - tenant)
skipping: [instance] => (item=crc-0 - tenant)
skipping: [instance]
TASK [libvirt_manager : Loop on host IPs] **************************************
Monday 29 September 2025 12:36:37 +0000 (0:00:00.153) 0:01:08.548 ******
skipping: [instance] => (item=compute-0 - external)
skipping: [instance] => (item=controller-0 - external)
skipping: [instance] => (item=crc-0 - external)
skipping: [instance]
TASK [libvirt_manager : Loop on host IPs] **************************************
Monday 29 September 2025 12:36:37 +0000 (0:00:00.080) 0:01:08.629 ******
skipping: [instance] => (item=compute-0 - storagemgmt)
skipping: [instance] => (item=controller-0 - storagemgmt)
skipping: [instance] => (item=crc-0 - storagemgmt)
skipping: [instance]
TASK [libvirt_manager : Loop on host IPs] **************************************
Monday 29 September 2025 12:36:37 +0000 (0:00:00.085) 0:01:08.714 ******
ok: [instance] => (item=compute-0 - public)
ok: [instance] => (item=controller-0 - public)
ok: [instance] => (item=crc-0 - public)
TASK [Inject DHCP entries for net {{ net_name }}] ******************************
Monday 29 September 2025 12:36:38 +0000 (0:00:00.176) 0:01:08.890 ******
TASK [dnsmasq : Ensure we have the right data and type] ************************
Monday 29 September 2025 12:36:38 +0000 (0:00:00.159) 0:01:09.050 ******
ok: [instance]
TASK [dnsmasq : Assert we have needed host data] *******************************
Monday 29 September 2025 12:36:38 +0000 (0:00:00.043) 0:01:09.094 ******
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6f:5f:c5', 'ips': ['192.168.140.100', '']})
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:5c:a5:4a', 'ips': ['192.168.140.9', '']})
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:bb:d7:df', 'ips': ['192.168.140.10', '']})
ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:90:39:f1', 'ips': ['192.168.101.100', '']})
ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a4:32:19', 'ips': ['192.168.101.9', '']})
ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:43:b1:b6', 'ips': ['192.168.101.10', '']})
TASK [dnsmasq : Ensure networks exists] ****************************************
Monday 29 September 2025 12:36:38 +0000 (0:00:00.098) 0:01:09.192 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
TASK [dnsmasq : Check network file status] *************************************
Monday 29 September 2025 12:36:38 +0000 (0:00:00.056) 0:01:09.249 ******
ok: [instance]
TASK [dnsmasq : Assert network exists] *****************************************
Monday 29 September 2025 12:36:38 +0000 (0:00:00.185) 0:01:09.434 ******
ok: [instance]
TASK [dnsmasq : Check network file status] *************************************
Monday 29 September 2025 12:36:38 +0000 (0:00:00.027) 0:01:09.462 ******
ok: [instance]
TASK [dnsmasq : Assert network exists] *****************************************
Monday 29 September 2025 12:36:38 +0000 (0:00:00.184) 0:01:09.646 ******
ok: [instance]
TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
Monday 29 September 2025 12:36:38 +0000 (0:00:00.027) 0:01:09.673 ******
ok: [instance]
TASK [dnsmasq : Compute entry] *************************************************
Monday 29 September 2025 12:36:38 +0000 (0:00:00.022) 0:01:09.695 ******
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6f:5f:c5', 'ips': ['192.168.140.100', '']})
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:5c:a5:4a', 'ips': ['192.168.140.9', '']})
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:bb:d7:df', 'ips': ['192.168.140.10', '']})
ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:90:39:f1', 'ips': ['192.168.101.100', '']})
ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a4:32:19', 'ips': ['192.168.101.9', '']})
ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:43:b1:b6', 'ips': ['192.168.101.10', '']})
TASK [dnsmasq : Create add/remove sets] ****************************************
Monday 29 September 2025 12:36:38 +0000 (0:00:00.167) 0:01:09.862 ******
ok: [instance]
TASK [dnsmasq : Add DHCP entries] **********************************************
Monday 29 September 2025 12:36:39 +0000 (0:00:00.039) 0:01:09.902 ******
changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:6f:5f:c5', 'entry': '52:54:00:6f:5f:c5,192.168.140.100,compute-0', 'state': 'present'})
changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:5c:a5:4a', 'entry': '52:54:01:5c:a5:4a,192.168.140.9,controller-0', 'state': 'present'})
changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:bb:d7:df', 'entry': '52:54:02:bb:d7:df,192.168.140.10,crc-0', 'state': 'present'})
changed: [instance] => (item={'file': 'public_compute-0_52:54:00:90:39:f1', 'entry': '52:54:00:90:39:f1,192.168.101.100,compute-0', 'state': 'present'})
changed: [instance] => (item={'file': 'public_controller-0_52:54:01:a4:32:19', 'entry': '52:54:01:a4:32:19,192.168.101.9,controller-0', 'state': 'present'})
changed: [instance] => (item={'file': 'public_crc-0_52:54:02:43:b1:b6', 'entry': '52:54:02:43:b1:b6,192.168.101.10,crc-0', 'state': 'present'})
TASK [dnsmasq : Remove DHCP entries] *******************************************
Monday 29 September 2025 12:36:41 +0000 (0:00:02.021) 0:01:11.923 ******
skipping: [instance]
TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
Monday 29 September 2025 12:36:41 +0000 (0:00:00.023) 0:01:11.947 ******
ok: [instance] => (item=compute-0)
ok: [instance] => (item=controller-0)
ok: [instance] => (item=crc-0)
TASK [Inject VMs in the .utility zone] *****************************************
Monday 29 September 2025 12:36:41 +0000 (0:00:00.203) 0:01:12.150 ******
TASK [dnsmasq : Assert we have needed host record data] ************************
Monday 29 September 2025 12:36:41 +0000 (0:00:00.118) 0:01:12.269 ******
ok: [instance]
TASK [dnsmasq : Assert each address element have needed data] ******************
Monday 29 September 2025 12:36:41 +0000 (0:00:00.041) 0:01:12.311 ******
ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
TASK [dnsmasq : Add/Remove address] ********************************************
Monday 29 September 2025 12:36:41 +0000 (0:00:00.200) 0:01:12.512 ******
changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
TASK [libvirt_manager : Ensure some domains are local] *************************
Monday 29 September 2025 12:36:44 +0000 (0:00:03.142) 0:01:15.654 ******
changed: [instance]
TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
Monday 29 September 2025 12:36:45 +0000 (0:00:00.365) 0:01:16.020 ******
RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
Monday 29 September 2025 12:36:45 +0000 (0:00:00.010) 0:01:16.031 ******
changed: [instance]
RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
Monday 29 September 2025 12:36:45 +0000 (0:00:00.796) 0:01:16.828 ******
changed: [instance]
RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
Monday 29 September 2025 12:36:46 +0000 (0:00:00.347) 0:01:17.175 ******
changed: [instance]
TASK [reproducer : Delegate our domains to our own instance] *******************
Monday 29 September 2025 12:36:46 +0000 (0:00:00.347) 0:01:17.523 ******
changed: [instance]
TASK [reproducer : Ensure "utility" domain is local] ***************************
Monday 29 September 2025 12:36:47 +0000 (0:00:00.376) 0:01:17.899 ******
changed: [instance]
TASK [Build utility records dataset] *******************************************
Monday 29 September 2025 12:36:47 +0000 (0:00:00.384) 0:01:18.284 ******
TASK [dnsmasq : Assert we have needed host record data] ************************
Monday 29 September 2025 12:36:47 +0000 (0:00:00.032) 0:01:18.316 ******
ok: [instance]
TASK [dnsmasq : Assert each address element have needed data] ******************
Monday 29 September 2025 12:36:47 +0000 (0:00:00.095) 0:01:18.412 ******
ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
TASK [dnsmasq : Add/Remove address] ********************************************
Monday 29 September 2025 12:36:47 +0000 (0:00:00.099) 0:01:18.511 ******
changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
TASK [reproducer : Flush handlers] *********************************************
Monday 29 September 2025 12:36:48 +0000 (0:00:00.460) 0:01:18.972 ******
RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
Monday 29 September 2025 12:36:48 +0000 (0:00:00.010) 0:01:18.982 ******
changed: [instance]
RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
Monday 29 September 2025 12:36:48 +0000 (0:00:00.478) 0:01:19.461 ******
changed: [instance]
TASK [reproducer : Bootstrap nat64 if needed] **********************************
Monday 29 September 2025 12:36:48 +0000 (0:00:00.343) 0:01:19.805 ******
skipping: [instance]
TASK [reproducer : Deploy CRC if needed] ***************************************
Monday 29 September 2025 12:36:48 +0000 (0:00:00.031) 0:01:19.836 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
TASK [reproducer : Check for CRC availability in known path] *******************
Monday 29 September 2025 12:36:49 +0000 (0:00:00.072) 0:01:19.908 ******
ok: [instance]
TASK [Deploy CRC if needed] ****************************************************
Monday 29 September 2025 12:36:49 +0000 (0:00:00.183) 0:01:20.092 ******
skipping: [instance]
TASK [rhol_crc : Stop CRC VM] **************************************************
Monday 29 September 2025 12:36:49 +0000 (0:00:00.020) 0:01:20.112 ******
ok: [instance]
TASK [rhol_crc : Undefine CRC VM] **********************************************
Monday 29 September 2025 12:36:49 +0000 (0:00:00.337) 0:01:20.449 ******
ok: [instance]
TASK [rhol_crc : Destroy CRC network] ******************************************
Monday 29 September 2025 12:36:49 +0000 (0:00:00.237) 0:01:20.687 ******
ok: [instance]
TASK [rhol_crc : Undefine CRC network] *****************************************
Monday 29 September 2025 12:36:50 +0000 (0:00:00.218) 0:01:20.906 ******
ok: [instance]
TASK [rhol_crc : Destroy default network] **************************************
Monday 29 September 2025 12:36:50 +0000 (0:00:00.224) 0:01:21.131 ******
ok: [instance]
TASK [Check if new ssh keypair exists] *****************************************
Monday 29 September 2025 12:36:50 +0000 (0:00:00.224) 0:01:21.356 ******
TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
Monday 29 September 2025 12:36:50 +0000 (0:00:00.039) 0:01:21.395 ******
ok: [instance]
TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
Monday 29 September 2025 12:36:50 +0000 (0:00:00.191) 0:01:21.586 ******
ok: [instance]
TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
Monday 29 September 2025 12:36:50 +0000 (0:00:00.023) 0:01:21.610 ******
skipping: [instance]
TASK [reproducer : Slurp ssh key for CRC access] *******************************
Monday 29 September 2025 12:36:50 +0000 (0:00:00.024) 0:01:21.635 ******
ok: [instance]
TASK [reproducer : Get kubeconfig file from crc directory] *********************
Monday 29 September 2025 12:36:51 +0000 (0:00:00.274) 0:01:21.909 ******
ok: [instance]
TASK [reproducer : Get kubeadmin-password file from crc directory] *************
Monday 29 September 2025 12:36:51 +0000 (0:00:00.213) 0:01:22.123 ******
ok: [instance]
TASK [Ensure we expose openshift_login related facts] **************************
Monday 29 September 2025 12:36:51 +0000 (0:00:00.173) 0:01:22.296 ******
TASK [openshift_login : Assert we have needed parameters] **********************
Monday 29 September 2025 12:36:51 +0000 (0:00:00.055) 0:01:22.352 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [openshift_login : Stat kubeconfig] ***************************************
Monday 29 September 2025 12:36:51 +0000 (0:00:00.042) 0:01:22.395 ******
ok: [instance]
TASK [openshift_login : Stat kubeadmin] ****************************************
Monday 29 September 2025 12:36:51 +0000 (0:00:00.173) 0:01:22.569 ******
ok: [instance]
TASK [openshift_login : Assert files exist] ************************************
Monday 29 September 2025 12:36:51 +0000 (0:00:00.190) 0:01:22.759 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [openshift_login : Gather the password of the deployed cluster.] **********
Monday 29 September 2025 12:36:51 +0000 (0:00:00.024) 0:01:22.783 ******
ok: [instance]
TASK [openshift_login : Gather the deployed OCP configuration.] ****************
Monday 29 September 2025 12:36:52 +0000 (0:00:00.185) 0:01:22.968 ******
ok: [instance]
TASK [openshift_login : Set the OpenShift platform access information.] ********
Monday 29 September 2025 12:36:52 +0000 (0:00:00.172) 0:01:23.141 ******
ok: [instance]
TASK [reproducer : Remove CRC managed zone delegation] *************************
Monday 29 September 2025 12:36:52 +0000 (0:00:00.045) 0:01:23.187 ******
changed: [instance] => (item=dnsmasq.d/crc.conf)
changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
Monday 29 September 2025 12:36:52 +0000 (0:00:00.382) 0:01:23.569 ******
skipping: [instance]
TASK [Load the architecture local kustomize patches] ***************************
Monday 29 September 2025 12:36:52 +0000 (0:00:00.019) 0:01:23.589 ******
skipping: [instance]
TASK [reproducer : Consume libvirt_manager] ************************************
Monday 29 September 2025 12:36:52 +0000 (0:00:00.023) 0:01:23.612 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
TASK [libvirt_manager : Import layout generator if needed] *********************
Monday 29 September 2025 12:36:52 +0000 (0:00:00.152) 0:01:23.765 ******
skipping: [instance]
TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
Monday 29 September 2025 12:36:52 +0000 (0:00:00.025) 0:01:23.790 ******
changed: [instance]
TASK [libvirt_manager : Enable masquerading for public traffic] ****************
Monday 29 September 2025 12:36:53 +0000 (0:00:00.398) 0:01:24.188 ******
changed: [instance]
TASK [libvirt_manager : Ensure firewalld is restarts] **************************
Monday 29 September 2025 12:36:53 +0000 (0:00:00.475) 0:01:24.663 ******
RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
Monday 29 September 2025 12:36:53 +0000 (0:00:00.011) 0:01:24.675 ******
changed: [instance]
RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
Monday 29 September 2025 12:36:54 +0000 (0:00:00.420) 0:01:25.096 ******
changed: [instance]
TASK [Deploy virtualbmc] *******************************************************
Monday 29 September 2025 12:36:55 +0000 (0:00:00.823) 0:01:25.919 ******
skipping: [instance]
TASK [libvirt_manager : Let the project know we have vbmc available] ***********
Monday 29 September 2025 12:36:55 +0000 (0:00:00.032) 0:01:25.952 ******
skipping: [instance]
TASK [libvirt_manager : Create needed workload directory] **********************
Monday 29 September 2025 12:36:55 +0000 (0:00:00.032) 0:01:25.984 ******
changed: [instance] => (item=workload)
changed: [instance] => (item=reproducer-inventory)
ok: [instance] => (item=volumes)
TASK [libvirt_manager : Allow QEMU on workload directory] **********************
Monday 29 September 2025 12:36:55 +0000 (0:00:00.555) 0:01:26.540 ******
changed: [instance] => (item=workload)
changed: [instance] => (item=volumes)
TASK [libvirt_manager : Generate networking data] ******************************
Monday 29 September 2025 12:36:56 +0000 (0:00:00.420) 0:01:26.960 ******
skipping: [instance]
TASK [libvirt_manager : Create group inventories] ******************************
Monday 29 September 2025 12:36:56 +0000 (0:00:00.026) 0:01:26.986 ******
changed: [instance] => (item=compute)
changed: [instance] => (item=controller)
changed: [instance] => (item=crc)
TASK [libvirt_manager : Create "all" group inventory file] *********************
Monday 29 September 2025 12:36:57 +0000 (0:00:01.049) 0:01:28.036 ******
changed: [instance]
TASK [libvirt_manager : Ensure storage pool is present.] ***********************
Monday 29 September 2025 12:36:57 +0000 (0:00:00.373) 0:01:28.410 ******
skipping: [instance]
TASK [libvirt_manager : Ensure images are present] *****************************
Monday 29 September 2025 12:36:57 +0000 (0:00:00.039) 0:01:28.449 ******
skipping: [instance] => (item=crc)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
TASK [libvirt_manager : Ensure directory exists] *******************************
Monday 29 September 2025 12:36:57 +0000 (0:00:00.063) 0:01:28.513 ******
changed: [instance]
TASK [libvirt_manager : Check if base image exists] ****************************
Monday 29 September 2025 12:36:57 +0000 (0:00:00.205) 0:01:28.718 ******
ok: [instance]
TASK [libvirt_manager : Download base image] ***********************************
Monday 29 September 2025 12:36:58 +0000 (0:00:00.176) 0:01:28.894 ******
changed: [instance]
TASK [libvirt_manager : Check image] *******************************************
Monday 29 September 2025 12:37:17 +0000 (0:00:19.977) 0:01:48.871 ******
ok: [instance]
TASK [libvirt_manager : Assert image status] ***********************************
Monday 29 September 2025 12:37:18 +0000 (0:00:00.189) 0:01:49.061 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [libvirt_manager : Ensure image access rights] ****************************
Monday 29 September 2025 12:37:18 +0000 (0:00:00.040) 0:01:49.101 ******
changed: [instance]
TASK [libvirt_manager : Ensure directory exists] *******************************
Monday 29 September 2025 12:37:18 +0000 (0:00:00.205) 0:01:49.307 ******
ok: [instance]
TASK [libvirt_manager : Check if base image exists] ****************************
Monday 29 September 2025 12:37:18 +0000 (0:00:00.203) 0:01:49.511 ******
ok: [instance]
TASK [libvirt_manager : Download base image] ***********************************
Monday 29 September 2025 12:37:18 +0000 (0:00:00.193) 0:01:49.704 ******
skipping: [instance]
TASK [libvirt_manager : Check image] *******************************************
Monday 29 September 2025 12:37:18 +0000 (0:00:00.022) 0:01:49.727 ******
ok: [instance]
TASK [libvirt_manager : Assert image status] ***********************************
Monday 29 September 2025 12:37:19 +0000 (0:00:00.195) 0:01:49.922 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [libvirt_manager : Ensure image access rights] ****************************
Monday 29 September 2025 12:37:19 +0000 (0:00:00.039) 0:01:49.961 ******
ok: [instance]
TASK [libvirt_manager : Get ssh key state] *************************************
Monday 29 September 2025 12:37:19 +0000 (0:00:00.202) 0:01:50.164 ******
ok: [instance]
TASK [libvirt_manager : Create temporary ssh keypair] **************************
Monday 29 September 2025 12:37:19 +0000 (0:00:00.170) 0:01:50.335 ******
changed: [instance]
TASK [libvirt_manager : Slurp public key for later use] ************************
Monday 29 September 2025 12:37:19 +0000 (0:00:00.378) 0:01:50.713 ******
ok: [instance]
TASK [libvirt_manager : Slurp private key for later use] ***********************
Monday 29 September 2025 12:37:20 +0000 (0:00:00.174) 0:01:50.887 ******
ok: [instance]
TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
Monday 29 September 2025 12:37:20 +0000 (0:00:00.175) 0:01:51.063 ******
changed: [instance]
TASK [libvirt_manager : Create fact holding network data for VMs] **************
Monday 29 September 2025 12:37:20 +0000 (0:00:00.412) 0:01:51.475 ******
ok: [instance]
TASK [libvirt_manager : List existing networks] ********************************
Monday 29 September 2025 12:37:20 +0000 (0:00:00.021) 0:01:51.496 ******
ok: [instance]
TASK [libvirt_manager : Gather pool fact] **************************************
Monday 29 September 2025 12:37:20 +0000 (0:00:00.268) 0:01:51.764 ******
ok: [instance]
TASK [libvirt_manager : Create and run VMs] ************************************
Monday 29 September 2025 12:37:21 +0000 (0:00:00.442) 0:01:52.207 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
TASK [libvirt_manager : Create VM image for compute-0] *************************
Monday 29 September 2025 12:37:21 +0000 (0:00:00.118) 0:01:52.325 ******
changed: [instance]
TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
Monday 29 September 2025 12:37:21 +0000 (0:00:00.259) 0:01:52.585 ******
changed: [instance]
TASK [libvirt_manager : Define VMs for type compute-0] *************************
Monday 29 September 2025 12:37:21 +0000 (0:00:00.226) 0:01:52.811 ******
changed: [instance]
TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
Monday 29 September 2025 12:37:22 +0000 (0:00:00.292) 0:01:53.104 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
Monday 29 September 2025 12:37:22 +0000 (0:00:00.029) 0:01:53.133 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
TASK [libvirt_manager : Get virtual network information] ***********************
Monday 29 September 2025 12:37:22 +0000 (0:00:00.043) 0:01:53.177 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Monday 29 September 2025 12:37:22 +0000 (0:00:00.231) 0:01:53.408 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Monday 29 September 2025 12:37:22 +0000 (0:00:00.044) 0:01:53.452 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Monday 29 September 2025 12:37:22 +0000 (0:00:00.227) 0:01:53.680 ******
ok: [instance]
TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
Monday 29 September 2025 12:37:22 +0000 (0:00:00.198) 0:01:53.878 ******
changed: [instance]
TASK [libvirt_manager : Get virtual network information] ***********************
Monday 29 September 2025 12:37:24 +0000 (0:00:01.291) 0:01:55.169 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Monday 29 September 2025 12:37:24 +0000 (0:00:00.236) 0:01:55.406 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Monday 29 September 2025 12:37:24 +0000 (0:00:00.043) 0:01:55.449 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Monday 29 September 2025 12:37:24 +0000 (0:00:00.228) 0:01:55.678 ******
ok: [instance]
TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
Monday 29 September 2025 12:37:25 +0000 (0:00:00.206) 0:01:55.884 ******
changed: [instance]
TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
Monday 29 September 2025 12:37:25 +0000 (0:00:00.294) 0:01:56.178 ******
skipping: [instance]
TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
Monday 29 September 2025 12:37:25 +0000 (0:00:00.021) 0:01:56.199 ******
skipping: [instance]
TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
Monday 29 September 2025 12:37:25 +0000 (0:00:00.028) 0:01:56.228 ******
skipping: [instance]
TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
Monday 29 September 2025 12:37:25 +0000 (0:00:00.028) 0:01:56.257 ******
skipping: [instance]
TASK [libvirt_manager : Get VM UUID] *******************************************
Monday 29 September 2025 12:37:25 +0000 (0:00:00.027) 0:01:56.284 ******
changed: [instance]
TASK [libvirt_manager : Inject UUID in dataset] ********************************
Monday 29 September 2025 12:37:25 +0000 (0:00:00.219) 0:01:56.504 ******
ok: [instance]
TASK [libvirt_manager : Create cloud-init ISO] *********************************
Monday 29 September 2025 12:37:25 +0000 (0:00:00.037) 0:01:56.541 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
Monday 29 September 2025 12:37:25 +0000 (0:00:00.054) 0:01:56.596 ******
ok: [instance]
TASK [libvirt_manager : Define the default users for the vm] *******************
Monday 29 September 2025 12:37:25 +0000 (0:00:00.199) 0:01:56.796 ******
ok: [instance]
TASK [libvirt_manager : Define the user data] **********************************
Monday 29 September 2025 12:37:25 +0000 (0:00:00.062) 0:01:56.858 ******
ok: [instance]
TASK [libvirt_manager : Define the network config for all vms] *****************
Monday 29 September 2025 12:37:26 +0000 (0:00:00.044) 0:01:56.903 ******
skipping: [instance]
TASK [libvirt_manager : Define the network config for each vm] *****************
Monday 29 September 2025 12:37:26 +0000 (0:00:00.041) 0:01:56.944 ******
skipping: [instance]
TASK [Call the config_drive role] **********************************************
Monday 29 September 2025 12:37:26 +0000 (0:00:00.044) 0:01:56.989 ******
TASK [config_drive : Ensure needed directories exist] **************************
Monday 29 September 2025 12:37:26 +0000 (0:00:00.059) 0:01:57.048 ******
ok: [instance] => (item=artifacts)
ok: [instance] => (item=logs)
TASK [config_drive : Install required RPM packages] ****************************
Monday 29 September 2025 12:37:26 +0000 (0:00:00.405) 0:01:57.454 ******
ok: [instance]
TASK [config_drive : Crate config drive instance directory] ********************
Monday 29 September 2025 12:37:27 +0000 (0:00:01.214) 0:01:58.668 ******
changed: [instance]
TASK [config_drive : Generate meta-data] ***************************************
Monday 29 September 2025 12:37:28 +0000 (0:00:00.219) 0:01:58.888 ******
changed: [instance]
TASK [config_drive : Generate user-data] ***************************************
Monday 29 September 2025 12:37:28 +0000 (0:00:00.366) 0:01:59.254 ******
changed: [instance]
TASK [config_drive : Generate network-data] ************************************
Monday 29 September 2025 12:37:28 +0000 (0:00:00.374) 0:01:59.628 ******
skipping: [instance]
TASK [config_drive : Check ISO availability] ***********************************
Monday 29 September 2025 12:37:28 +0000 (0:00:00.042) 0:01:59.671 ******
ok: [instance]
TASK [config_drive : Assert we don't try to change an existing ISO] ************
Monday 29 September 2025 12:37:28 +0000 (0:00:00.204) 0:01:59.876 ******
skipping: [instance]
TASK [config_drive : Generate nocloud iso image] *******************************
Monday 29 September 2025 12:37:29 +0000 (0:00:00.042) 0:01:59.918 ******
Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
changed: [instance]
TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
Monday 29 September 2025 12:37:29 +0000 (0:00:00.234) 0:02:00.152 ******
changed: [instance]
TASK [libvirt_manager : Attach additional devices if specified] ****************
Monday 29 September 2025 12:37:29 +0000 (0:00:00.274) 0:02:00.427 ******
skipping: [instance]
TASK [libvirt_manager : Create VM image for controller-0] **********************
Monday 29 September 2025 12:37:29 +0000 (0:00:00.097) 0:02:00.524 ******
changed: [instance]
TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
Monday 29 September 2025 12:37:29 +0000 (0:00:00.244) 0:02:00.769 ******
changed: [instance]
TASK [libvirt_manager : Define VMs for type controller-0] **********************
Monday 29 September 2025 12:37:30 +0000 (0:00:00.236) 0:02:01.005 ******
changed: [instance]
TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
Monday 29 September 2025 12:37:30 +0000 (0:00:00.292) 0:02:01.297 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
Monday 29 September 2025 12:37:30 +0000 (0:00:00.030) 0:02:01.327 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
TASK [libvirt_manager : Get virtual network information] ***********************
Monday 29 September 2025 12:37:30 +0000 (0:00:00.054) 0:02:01.382 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Monday 29 September 2025 12:37:30 +0000 (0:00:00.267) 0:02:01.649 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Monday 29 September 2025 12:37:30 +0000 (0:00:00.047) 0:02:01.696 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Monday 29 September 2025 12:37:31 +0000 (0:00:00.243) 0:02:01.940 ******
ok: [instance]
TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
Monday 29 September 2025 12:37:31 +0000 (0:00:00.206) 0:02:02.146 ******
changed: [instance]
TASK [libvirt_manager : Get virtual network information] ***********************
Monday 29 September 2025 12:37:31 +0000 (0:00:00.295) 0:02:02.441 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Monday 29 September 2025 12:37:31 +0000 (0:00:00.238) 0:02:02.680 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Monday 29 September 2025 12:37:31 +0000 (0:00:00.044) 0:02:02.725 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Monday 29 September 2025 12:37:32 +0000 (0:00:00.231) 0:02:02.956 ******
ok: [instance]
TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
Monday 29 September 2025 12:37:32 +0000 (0:00:00.213) 0:02:03.170 ******
changed: [instance]
TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
Monday 29 September 2025 12:37:32 +0000 (0:00:00.291) 0:02:03.461 ******
skipping: [instance]
TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
Monday 29 September 2025 12:37:32 +0000 (0:00:00.021) 0:02:03.483 ******
skipping: [instance]
TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
Monday 29 September 2025 12:37:32 +0000 (0:00:00.029) 0:02:03.513 ******
skipping: [instance]
TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
Monday 29 September 2025 12:37:32 +0000 (0:00:00.030) 0:02:03.543 ******
skipping: [instance]
TASK [libvirt_manager : Get VM UUID] *******************************************
Monday 29 September 2025 12:37:32 +0000 (0:00:00.027) 0:02:03.571 ******
changed: [instance]
TASK [libvirt_manager : Inject UUID in dataset] ********************************
Monday 29 September 2025 12:37:32 +0000 (0:00:00.219) 0:02:03.790 ******
ok: [instance]
TASK [libvirt_manager : Create cloud-init ISO] *********************************
Monday 29 September 2025 12:37:32 +0000 (0:00:00.040) 0:02:03.831 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
Monday 29 September 2025 12:37:33 +0000 (0:00:00.055) 0:02:03.886 ******
ok: [instance]
TASK [libvirt_manager : Define the default users for the vm] *******************
Monday 29 September 2025 12:37:33 +0000 (0:00:00.196) 0:02:04.083 ******
ok: [instance]
TASK [libvirt_manager : Define the user data] **********************************
Monday 29 September 2025 12:37:33 +0000 (0:00:00.062) 0:02:04.145 ******
ok: [instance]
TASK [libvirt_manager : Define the network config for all vms] *****************
Monday 29 September 2025 12:37:33 +0000 (0:00:00.044) 0:02:04.190 ******
skipping: [instance]
TASK [libvirt_manager : Define the network config for each vm] *****************
Monday 29 September 2025 12:37:33 +0000 (0:00:00.041) 0:02:04.231 ******
skipping: [instance]
TASK [Call the config_drive role] **********************************************
Monday 29 September 2025 12:37:33 +0000 (0:00:00.042) 0:02:04.274 ******
TASK [config_drive : Ensure needed directories exist] **************************
Monday 29 September 2025 12:37:33 +0000 (0:00:00.062) 0:02:04.337 ******
ok: [instance] => (item=artifacts)
ok: [instance] => (item=logs)
TASK [config_drive : Install required RPM packages] ****************************
Monday 29 September 2025 12:37:33 +0000 (0:00:00.392) 0:02:04.729 ******
ok: [instance]
TASK [config_drive : Crate config drive instance directory] ********************
Monday 29 September 2025 12:37:35 +0000 (0:00:01.181) 0:02:05.911 ******
changed: [instance]
TASK [config_drive : Generate meta-data] ***************************************
Monday 29 September 2025 12:37:35 +0000 (0:00:00.216) 0:02:06.127 ******
changed: [instance]
TASK [config_drive : Generate user-data] ***************************************
Monday 29 September 2025 12:37:35 +0000 (0:00:00.373) 0:02:06.500 ******
changed: [instance]
TASK [config_drive : Generate network-data] ************************************
Monday 29 September 2025 12:37:36 +0000 (0:00:00.379) 0:02:06.880 ******
skipping: [instance]
TASK [config_drive : Check ISO availability] ***********************************
Monday 29 September 2025 12:37:36 +0000 (0:00:00.045) 0:02:06.926 ******
ok: [instance]
TASK [config_drive : Assert we don't try to change an existing ISO] ************
Monday 29 September 2025 12:37:36 +0000 (0:00:00.203) 0:02:07.129 ******
skipping: [instance]
TASK [config_drive : Generate nocloud iso image] *******************************
Monday 29 September 2025 12:37:36 +0000 (0:00:00.042) 0:02:07.171 ******
Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
changed: [instance]
TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
Monday 29 September 2025 12:37:36 +0000 (0:00:00.242) 0:02:07.414 ******
changed: [instance]
TASK [libvirt_manager : Attach additional devices if specified] ****************
Monday 29 September 2025 12:37:36 +0000 (0:00:00.269) 0:02:07.684 ******
skipping: [instance]
TASK [libvirt_manager : Create VM image for crc-0] *****************************
Monday 29 September 2025 12:37:36 +0000 (0:00:00.045) 0:02:07.729 ******
changed: [instance]
TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
Monday 29 September 2025 12:37:37 +0000 (0:00:00.286) 0:02:08.016 ******
changed: [instance]
TASK [libvirt_manager : Define VMs for type crc-0] *****************************
Monday 29 September 2025 12:37:37 +0000 (0:00:00.265) 0:02:08.281 ******
changed: [instance]
TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
Monday 29 September 2025 12:37:37 +0000 (0:00:00.361) 0:02:08.643 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
Monday 29 September 2025 12:37:37 +0000 (0:00:00.032) 0:02:08.675 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
TASK [libvirt_manager : Get virtual network information] ***********************
Monday 29 September 2025 12:37:37 +0000 (0:00:00.049) 0:02:08.725 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Monday 29 September 2025 12:37:38 +0000 (0:00:00.247) 0:02:08.972 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Monday 29 September 2025 12:37:38 +0000 (0:00:00.060) 0:02:09.033 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Monday 29 September 2025 12:37:38 +0000 (0:00:00.269) 0:02:09.302 ******
ok: [instance]
TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
Monday 29 September 2025 12:37:38 +0000 (0:00:00.211) 0:02:09.514 ******
changed: [instance]
TASK [libvirt_manager : Get virtual network information] ***********************
Monday 29 September 2025 12:37:38 +0000 (0:00:00.315) 0:02:09.830 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Monday 29 September 2025 12:37:39 +0000 (0:00:00.249) 0:02:10.079 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Monday 29 September 2025 12:37:39 +0000 (0:00:00.049) 0:02:10.128 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Monday 29 September 2025 12:37:39 +0000 (0:00:00.251) 0:02:10.380 ******
ok: [instance]
TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
Monday 29 September 2025 12:37:39 +0000 (0:00:00.214) 0:02:10.594 ******
changed: [instance]
TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
Monday 29 September 2025 12:37:40 +0000 (0:00:00.300) 0:02:10.894 ******
skipping: [instance]
TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
Monday 29 September 2025 12:37:40 +0000 (0:00:00.023) 0:02:10.917 ******
skipping: [instance]
TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
Monday 29 September 2025 12:37:40 +0000 (0:00:00.028) 0:02:10.946 ******
skipping: [instance]
TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
Monday 29 September 2025 12:37:40 +0000 (0:00:00.028) 0:02:10.975 ******
skipping: [instance]
TASK [libvirt_manager : Get VM UUID] *******************************************
Monday 29 September 2025 12:37:40 +0000 (0:00:00.028) 0:02:11.003 ******
changed: [instance]
TASK [libvirt_manager : Inject UUID in dataset] ********************************
Monday 29 September 2025 12:37:40 +0000 (0:00:00.240) 0:02:11.244 ******
ok: [instance]
TASK [libvirt_manager : Create cloud-init ISO] *********************************
Monday 29 September 2025 12:37:40 +0000 (0:00:00.039) 0:02:11.283 ******
skipping: [instance]
TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
Monday 29 September 2025 12:37:40 +0000 (0:00:00.031) 0:02:11.315 ******
skipping: [instance]
TASK [libvirt_manager : Attach additional devices if specified] ****************
Monday 29 September 2025 12:37:40 +0000 (0:00:00.028) 0:02:11.343 ******
skipping: [instance]
TASK [libvirt_manager : Start (power-on) VMs] **********************************
Monday 29 September 2025 12:37:40 +0000 (0:00:00.047) 0:02:11.390 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
Monday 29 September 2025 12:37:40 +0000 (0:00:00.062) 0:02:11.453 ******
ok: [instance] => (item=crc)
TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
Monday 29 September 2025 12:37:40 +0000 (0:00:00.271) 0:02:11.725 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
TASK [libvirt_manager : Start vm] **********************************************
Monday 29 September 2025 12:37:42 +0000 (0:00:02.072) 0:02:13.797 ******
changed: [instance]
TASK [libvirt_manager : Start vm] **********************************************
Monday 29 September 2025 12:37:43 +0000 (0:00:00.919) 0:02:14.716 ******
changed: [instance]
TASK [libvirt_manager : Start vm] **********************************************
Monday 29 September 2025 12:37:44 +0000 (0:00:00.862) 0:02:15.579 ******
changed: [instance]
TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
Monday 29 September 2025 12:37:45 +0000 (0:00:00.920) 0:02:16.499 ******
changed: [instance] => (item=compute-0.utility)
changed: [instance] => (item=controller-0.utility)
changed: [instance] => (item=crc-0.utility)
TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
Monday 29 September 2025 12:37:46 +0000 (0:00:00.765) 0:02:17.264 ******
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j85283086744.23736', 'results_file': '/home/zuul/.ansible_async/j85283086744.23736', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j688059441888.23753', 'results_file': '/home/zuul/.ansible_async/j688059441888.23753', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j559997012107.23769', 'results_file': '/home/zuul/.ansible_async/j559997012107.23769', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
TASK [libvirt_manager : Configure managed VMs] *********************************
Monday 29 September 2025 12:38:06 +0000 (0:00:19.861) 0:02:37.126 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
TASK [Check if new ssh keypair exists] *****************************************
Monday 29 September 2025 12:38:06 +0000 (0:00:00.113) 0:02:37.240 ******
skipping: [instance]
TASK [Push ssh jumper/configuration for compute-0] *****************************
Monday 29 September 2025 12:38:06 +0000 (0:00:00.034) 0:02:37.274 ******
TASK [ssh_jumper : Create ssh-jumper entries] **********************************
Monday 29 September 2025 12:38:06 +0000 (0:00:00.042) 0:02:37.316 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
Monday 29 September 2025 12:38:06 +0000 (0:00:00.085) 0:02:37.401 ******
changed: [instance]
TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
Monday 29 September 2025 12:38:06 +0000 (0:00:00.247) 0:02:37.648 ******
changed: [instance]
TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
Monday 29 September 2025 12:38:07 +0000 (0:00:00.237) 0:02:37.886 ******
changed: [instance]
TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
Monday 29 September 2025 12:38:07 +0000 (0:00:00.423) 0:02:38.309 ******
skipping: [instance]
TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
Monday 29 September 2025 12:38:07 +0000 (0:00:00.028) 0:02:38.337 ******
skipping: [instance]
TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
Monday 29 September 2025 12:38:07 +0000 (0:00:00.030) 0:02:38.368 ******
skipping: [instance]
TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
Monday 29 September 2025 12:38:07 +0000 (0:00:00.056) 0:02:38.425 ******
skipping: [instance]
TASK [Check if new ssh keypair exists] *****************************************
Monday 29 September 2025 12:38:07 +0000 (0:00:00.058) 0:02:38.483 ******
skipping: [instance]
TASK [Push ssh jumper/configuration for controller-0] **************************
Monday 29 September 2025 12:38:07 +0000 (0:00:00.033) 0:02:38.516 ******
TASK [ssh_jumper : Create ssh-jumper entries] **********************************
Monday 29 September 2025 12:38:07 +0000 (0:00:00.049) 0:02:38.566 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
Monday 29 September 2025 12:38:07 +0000 (0:00:00.100) 0:02:38.666 ******
ok: [instance]
TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
Monday 29 September 2025 12:38:08 +0000 (0:00:00.241) 0:02:38.908 ******
ok: [instance]
TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
Monday 29 September 2025 12:38:08 +0000 (0:00:00.239) 0:02:39.147 ******
changed: [instance]
TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
Monday 29 September 2025 12:38:08 +0000 (0:00:00.393) 0:02:39.540 ******
skipping: [instance]
TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
Monday 29 September 2025 12:38:08 +0000 (0:00:00.040) 0:02:39.580 ******
skipping: [instance]
TASK [libvirt_manager : Inject private key on hosts controller-0] **************
Monday 29 September 2025 12:38:08 +0000 (0:00:00.038) 0:02:39.619 ******
changed: [instance -> controller-0.instance]
TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
Monday 29 September 2025 12:38:10 +0000 (0:00:01.657) 0:02:41.276 ******
changed: [instance -> controller-0.instance]
TASK [Check if new ssh keypair exists] *****************************************
Monday 29 September 2025 12:38:11 +0000 (0:00:01.159) 0:02:42.436 ******
TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
Monday 29 September 2025 12:38:11 +0000 (0:00:00.052) 0:02:42.488 ******
ok: [instance]
TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
Monday 29 September 2025 12:38:11 +0000 (0:00:00.229) 0:02:42.717 ******
ok: [instance]
TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
Monday 29 September 2025 12:38:11 +0000 (0:00:00.026) 0:02:42.744 ******
skipping: [instance]
TASK [Push ssh jumper/configuration for crc-0] *********************************
Monday 29 September 2025 12:38:11 +0000 (0:00:00.033) 0:02:42.778 ******
TASK [ssh_jumper : Create ssh-jumper entries] **********************************
Monday 29 September 2025 12:38:11 +0000 (0:00:00.054) 0:02:42.832 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
Monday 29 September 2025 12:38:12 +0000 (0:00:00.084) 0:02:42.916 ******
ok: [instance]
TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
Monday 29 September 2025 12:38:12 +0000 (0:00:00.243) 0:02:43.160 ******
ok: [instance]
TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
Monday 29 September 2025 12:38:12 +0000 (0:00:00.252) 0:02:43.412 ******
changed: [instance]
TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
Monday 29 September 2025 12:38:12 +0000 (0:00:00.443) 0:02:43.855 ******
changed: [instance]
TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
Monday 29 September 2025 12:38:13 +0000 (0:00:00.773) 0:02:44.629 ******
skipping: [instance]
TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
Monday 29 September 2025 12:38:13 +0000 (0:00:00.029) 0:02:44.658 ******
skipping: [instance]
TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
Monday 29 September 2025 12:38:13 +0000 (0:00:00.048) 0:02:44.707 ******
skipping: [instance]
TASK [Create VBMC entity] ******************************************************
Monday 29 September 2025 12:38:13 +0000 (0:00:00.046) 0:02:44.754 ******
skipping: [instance] => (item=compute-0)
skipping: [instance] => (item=controller-0)
skipping: [instance] => (item=crc-0)
skipping: [instance]
TASK [libvirt_manager : List running virtual machines.] ************************
Monday 29 September 2025 12:38:13 +0000 (0:00:00.064) 0:02:44.819 ******
ok: [instance]
TASK [libvirt_manager : Dump UUIDs] ********************************************
Monday 29 September 2025 12:38:14 +0000 (0:00:00.260) 0:02:45.079 ******
changed: [instance]
TASK [Ensure fresh vbmc listing] ***********************************************
Monday 29 September 2025 12:38:14 +0000 (0:00:00.417) 0:02:45.496 ******
skipping: [instance]
TASK [libvirt_manager : Update vbmc related fact] ******************************
Monday 29 September 2025 12:38:14 +0000 (0:00:00.037) 0:02:45.533 ******
skipping: [instance]
TASK [libvirt_manager : Dump vbmc known hosts] *********************************
Monday 29 September 2025 12:38:14 +0000 (0:00:00.042) 0:02:45.576 ******
skipping: [instance]
TASK [libvirt_manager : Copy authorized_keys] **********************************
Monday 29 September 2025 12:38:14 +0000 (0:00:00.042) 0:02:45.618 ******
changed: [instance]
TASK [libvirt_manager : Enable root access on CRC] *****************************
Monday 29 September 2025 12:38:15 +0000 (0:00:00.764) 0:02:46.383 ******
changed: [instance]
TASK [reproducer : Get deployed VM group inventories] **************************
Monday 29 September 2025 12:38:16 +0000 (0:00:00.711) 0:02:47.095 ******
skipping: [instance]
TASK [reproducer : Inject remote inventories onto main hypervisor] *************
Monday 29 September 2025 12:38:16 +0000 (0:00:00.041) 0:02:47.136 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
TASK [reproducer : Gather inventories from instance] ***************************
Monday 29 September 2025 12:38:16 +0000 (0:00:00.066) 0:02:47.203 ******
skipping: [instance]
TASK [reproducer : Gather inventories from compute-0] **************************
Monday 29 September 2025 12:38:16 +0000 (0:00:00.046) 0:02:47.249 ******
skipping: [instance]
TASK [reproducer : Gather inventories from controller-0] ***********************
Monday 29 September 2025 12:38:16 +0000 (0:00:00.044) 0:02:47.294 ******
skipping: [instance]
TASK [reproducer : Gather inventories from crc-0] ******************************
Monday 29 September 2025 12:38:16 +0000 (0:00:00.057) 0:02:47.352 ******
skipping: [instance]
TASK [reproducer : Push generated inventory from hypervisor] *******************
Monday 29 September 2025 12:38:16 +0000 (0:00:00.049) 0:02:47.401 ******
changed: [instance]
TASK [reproducer : Slurp devscripts private key] *******************************
Monday 29 September 2025 12:38:17 +0000 (0:00:00.662) 0:02:48.063 ******
skipping: [instance]
TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
Monday 29 September 2025 12:38:17 +0000 (0:00:00.032) 0:02:48.095 ******
skipping: [instance]
TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
Monday 29 September 2025 12:38:17 +0000 (0:00:00.033) 0:02:48.129 ******
skipping: [instance]
TASK [openshift_login : Assert we have needed parameters] **********************
Monday 29 September 2025 12:38:17 +0000 (0:00:00.030) 0:02:48.160 ******
skipping: [instance]
TASK [openshift_login : Stat kubeconfig] ***************************************
Monday 29 September 2025 12:38:17 +0000 (0:00:00.034) 0:02:48.194 ******
skipping: [instance]
TASK [openshift_login : Stat kubeadmin] ****************************************
Monday 29 September 2025 12:38:17 +0000 (0:00:00.032) 0:02:48.226 ******
skipping: [instance]
TASK [openshift_login : Assert files exist] ************************************
Monday 29 September 2025 12:38:17 +0000 (0:00:00.032) 0:02:48.258 ******
skipping: [instance]
TASK [openshift_login : Gather the password of the deployed cluster.] **********
Monday 29 September 2025 12:38:17 +0000 (0:00:00.035) 0:02:48.294 ******
skipping: [instance]
TASK [openshift_login : Gather the deployed OCP configuration.] ****************
Monday 29 September 2025 12:38:17 +0000 (0:00:00.032) 0:02:48.326 ******
skipping: [instance]
TASK [openshift_login : Set the OpenShift platform access information.] ********
Monday 29 September 2025 12:38:17 +0000 (0:00:00.037) 0:02:48.364 ******
skipping: [instance]
TASK [reproducer : Set fact for later wait on OCP cluster] *********************
Monday 29 September 2025 12:38:17 +0000 (0:00:00.047) 0:02:48.411 ******
skipping: [instance]
TASK [reproducer : Configure Controller node] **********************************
Monday 29 September 2025 12:38:17 +0000 (0:00:00.035) 0:02:48.446 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
TASK [reproducer : Set facts related to the reproducer] ************************
Monday 29 September 2025 12:38:17 +0000 (0:00:00.202) 0:02:48.649 ******
ok: [instance]
TASK [reproducer : Ensure directories exist] ***********************************
Monday 29 September 2025 12:38:17 +0000 (0:00:00.031) 0:02:48.680 ******
changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
TASK [reproducer : Tweak dnf configuration] ************************************
Monday 29 September 2025 12:38:19 +0000 (0:00:01.285) 0:02:49.966 ******
skipping: [instance]
TASK [install_ca : Ensure target directory exists] *****************************
Monday 29 September 2025 12:38:19 +0000 (0:00:00.026) 0:02:49.993 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [install_ca : Install internal CA from url] *******************************
Monday 29 September 2025 12:38:19 +0000 (0:00:00.622) 0:02:50.615 ******
skipping: [instance]
TASK [install_ca : Install custom CA bundle from inline] ***********************
Monday 29 September 2025 12:38:19 +0000 (0:00:00.044) 0:02:50.660 ******
skipping: [instance]
TASK [install_ca : Install custom CA bundle from file] *************************
Monday 29 September 2025 12:38:19 +0000 (0:00:00.041) 0:02:50.701 ******
skipping: [instance]
TASK [install_ca : Update ca bundle] *******************************************
Monday 29 September 2025 12:38:19 +0000 (0:00:00.040) 0:02:50.742 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Get rhos-release] *******************************************
Monday 29 September 2025 12:38:21 +0000 (0:00:01.541) 0:02:52.284 ******
skipping: [instance]
TASK [reproducer : Install repos] **********************************************
Monday 29 September 2025 12:38:21 +0000 (0:00:00.048) 0:02:52.332 ******
skipping: [instance]
TASK [reproducer : Run custom commands after rhos-release setup] ***************
Monday 29 September 2025 12:38:21 +0000 (0:00:00.043) 0:02:52.375 ******
skipping: [instance]
TASK [reproducer : Create bundle for CRC] **************************************
Monday 29 September 2025 12:38:21 +0000 (0:00:00.040) 0:02:52.416 ******
skipping: [instance]
TASK [reproducer : Install some tools] *****************************************
Monday 29 September 2025 12:38:21 +0000 (0:00:00.042) 0:02:52.459 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Inject command aliases for faster debugging] ****************
Monday 29 September 2025 12:38:22 +0000 (0:00:01.244) 0:02:53.703 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Build job inventory for hook usage] *************************
Monday 29 September 2025 12:38:23 +0000 (0:00:01.131) 0:02:54.834 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Push the MAC mapping data] **********************************
Monday 29 September 2025 12:38:24 +0000 (0:00:00.667) 0:02:55.502 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
Monday 29 September 2025 12:38:25 +0000 (0:00:01.027) 0:02:56.529 ******
changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
skipping: [instance] => (item=compute-0)
skipping: [instance] => (item=controller-0)
skipping: [instance] => (item=crc-0)
TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
Monday 29 September 2025 12:38:26 +0000 (0:00:01.289) 0:02:57.818 ******
fatal: [instance -> controller-0]: FAILED! =>
msg: |-
The task includes an option with an undefined variable. The error was: 'anisble_user_id' is undefined. 'anisble_user_id' is undefined
The error appears to be in '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml': line 160, column 7, but may
be elsewhere in the file depending on the exact syntax problem.
The offending line appears to be:
# options set in the ansible inventory.
- name: Inject remote hypervisor SSH configuration
^ here
TASK [Create dnsmasq dir] ******************************************************
Monday 29 September 2025 12:38:27 +0000 (0:00:00.098) 0:02:57.917 ******
changed: [instance]
TASK [Get journalctl in a file] ************************************************
Monday 29 September 2025 12:38:27 +0000 (0:00:00.230) 0:02:58.148 ******
changed: [instance]
TASK [Dump journalctl output] **************************************************
Monday 29 September 2025 12:38:27 +0000 (0:00:00.241) 0:02:58.389 ******
changed: [instance]
TASK [Copy all dnsmasq config] *************************************************
Monday 29 September 2025 12:38:27 +0000 (0:00:00.437) 0:02:58.826 ******
changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
TASK [Create log directory] ****************************************************
Monday 29 September 2025 12:38:28 +0000 (0:00:00.726) 0:02:59.553 ******
changed: [instance]
TASK [Sync logs from controller-0] *********************************************
Monday 29 September 2025 12:38:28 +0000 (0:00:00.214) 0:02:59.768 ******
changed: [instance]
PLAY RECAP *********************************************************************
instance : ok=380 changed=128 unreachable=0 failed=1 skipped=122 rescued=0 ignored=0
Monday 29 September 2025 12:38:29 +0000 (0:00:01.005) 0:03:00.773 ******
===============================================================================
libvirt_manager : Download base image ---------------------------------- 19.98s
libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.86s
libvirt_manager : Install packages required for using KVM -------------- 10.01s
ci_nmstate : Install required packages on localhost --------------------- 7.66s
dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.79s
dnsmasq : Add/Remove address -------------------------------------------- 3.14s
libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s
dnsmasq : Add DHCP entries ---------------------------------------------- 2.02s
libvirt_manager : Inject private key on hosts controller-0 -------------- 1.66s
ci_nmstate : Apply the desidered state on instance ---------------------- 1.65s
ci_nmstate : Apply the desidered state on localhost --------------------- 1.62s
discover_latest_image : Get latest image -------------------------------- 1.58s
install_ca : Update ca bundle ------------------------------------------- 1.54s
reproducer : Restart NetworkManager ------------------------------------- 1.34s
libvirt_manager : Attach interface public on cifmw-compute-0 ------------ 1.29s
reproducer : Inject other Hypervisor SSH keys --------------------------- 1.29s
reproducer : Ensure directories exist ----------------------------------- 1.29s
reproducer : Install some tools ----------------------------------------- 1.24s
config_drive : Install required RPM packages ---------------------------- 1.21s
ci_nmstate : Install required packages on instance ---------------------- 1.21s