PLAY [Prepare] *****************************************************************
TASK [Gathering Facts] *********************************************************
Thursday 09 October 2025 21:02:29 +0000 (0:00:00.018) 0:00:00.018 ******
ok: [instance]
TASK [Create custom basedir] ***************************************************
Thursday 09 October 2025 21:02:30 +0000 (0:00:00.834) 0:00:00.853 ******
changed: [instance]
TASK [test_deps : Gather facts if they don't exist] ****************************
Thursday 09 October 2025 21:02:30 +0000 (0:00:00.334) 0:00:01.188 ******
skipping: [instance]
TASK [test_deps : Gather variables for each operating system] ******************
Thursday 09 October 2025 21:02:30 +0000 (0:00:00.025) 0:00:01.213 ******
ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
TASK [test_deps : Detect mirrors file] *****************************************
Thursday 09 October 2025 21:02:31 +0000 (0:00:00.046) 0:00:01.260 ******
ok: [instance]
TASK [test_deps : Disable ubi host subscription-manager integration] ***********
Thursday 09 October 2025 21:02:31 +0000 (0:00:00.276) 0:00:01.536 ******
ok: [instance]
TASK [test_deps : Disable ubi 9 repos] *****************************************
Thursday 09 October 2025 21:02:31 +0000 (0:00:00.208) 0:00:01.745 ******
ok: [instance] => (item=ubi-9-appstream)
ok: [instance] => (item=ubi-9-baseos)
ok: [instance] => (item=ubi-9-codeready-builder)
TASK [Deploy repo-setup] *******************************************************
Thursday 09 October 2025 21:02:32 +0000 (0:00:00.675) 0:00:02.420 ******
TASK [repo_setup : Ensure directories are present] *****************************
Thursday 09 October 2025 21:02:32 +0000 (0:00:00.061) 0:00:02.482 ******
changed: [instance] => (item=tmp)
changed: [instance] => (item=artifacts/repositories)
changed: [instance] => (item=venv/repo_setup)
TASK [repo_setup : Make sure git-core package is installed] ********************
Thursday 09 October 2025 21:02:32 +0000 (0:00:00.521) 0:00:03.003 ******
ok: [instance]
TASK [repo_setup : Get repo-setup repository] **********************************
Thursday 09 October 2025 21:02:33 +0000 (0:00:00.775) 0:00:03.778 ******
changed: [instance]
TASK [repo_setup : Initialize python venv and install requirements] ************
Thursday 09 October 2025 21:02:34 +0000 (0:00:01.172) 0:00:04.951 ******
changed: [instance]
TASK [repo_setup : Install repo-setup package] *********************************
Thursday 09 October 2025 21:02:42 +0000 (0:00:07.606) 0:00:12.557 ******
changed: [instance]
TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
Thursday 09 October 2025 21:02:43 +0000 (0:00:00.699) 0:00:13.256 ******
skipping: [instance]
TASK [repo_setup : Run repo-setup] *********************************************
Thursday 09 October 2025 21:02:43 +0000 (0:00:00.023) 0:00:13.280 ******
changed: [instance]
TASK [repo_setup : Get component repo] *****************************************
Thursday 09 October 2025 21:02:43 +0000 (0:00:00.843) 0:00:14.124 ******
skipping: [instance]
TASK [repo_setup : Rename component repo] **************************************
Thursday 09 October 2025 21:02:43 +0000 (0:00:00.034) 0:00:14.159 ******
skipping: [instance]
TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
Thursday 09 October 2025 21:02:43 +0000 (0:00:00.034) 0:00:14.193 ******
skipping: [instance]
TASK [repo_setup : Run repo-setup-get-hash] ************************************
Thursday 09 October 2025 21:02:43 +0000 (0:00:00.036) 0:00:14.229 ******
changed: [instance]
TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
Thursday 09 October 2025 21:02:44 +0000 (0:00:00.530) 0:00:14.760 ******
changed: [instance]
TASK [repo_setup : Dump current-podified hash] *********************************
Thursday 09 October 2025 21:02:44 +0000 (0:00:00.422) 0:00:15.182 ******
skipping: [instance]
TASK [repo_setup : Slurp current podified hash] ********************************
Thursday 09 October 2025 21:02:44 +0000 (0:00:00.029) 0:00:15.211 ******
skipping: [instance]
TASK [repo_setup : Update the value of full_hash] ******************************
Thursday 09 October 2025 21:02:44 +0000 (0:00:00.028) 0:00:15.240 ******
skipping: [instance]
TASK [repo_setup : Export hashes facts for further use] ************************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.028) 0:00:15.268 ******
ok: [instance]
TASK [repo_setup : Create download directory] **********************************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.035) 0:00:15.304 ******
skipping: [instance]
TASK [repo_setup : Print the URL to request] ***********************************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.330 ******
skipping: [instance]
TASK [Download the RPM] ********************************************************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.357 ******
skipping: [instance]
TASK [repo_setup : Install RHOS Release tool] **********************************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.027) 0:00:15.384 ******
skipping: [instance]
TASK [repo_setup : Get rhos-release tool version] ******************************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.411 ******
skipping: [instance]
TASK [repo_setup : Print rhos-release tool version] ****************************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.027) 0:00:15.439 ******
skipping: [instance]
TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.029) 0:00:15.468 ******
skipping: [instance]
TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.495 ******
ok: [instance]
TASK [repo_setup : Use RDO proxy mirrors] **************************************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.188) 0:00:15.683 ******
changed: [instance]
TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.207) 0:00:15.890 ******
changed: [instance]
TASK [repo_setup : Check for gating.repo file on content provider] *************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.219) 0:00:16.110 ******
skipping: [instance]
TASK [repo_setup : Populate gating repo from content provider ip] **************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.021) 0:00:16.131 ******
skipping: [instance]
TASK [repo_setup : Check for DLRN repo at the destination] *********************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.021) 0:00:16.153 ******
skipping: [instance]
TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.020) 0:00:16.173 ******
skipping: [instance]
TASK [repo_setup : Check for DLRN component repo] ******************************
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.020) 0:00:16.193 ******
skipping: [instance]
TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] ***
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.022) 0:00:16.215 ******
skipping: [instance]
TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
Thursday 09 October 2025 21:02:45 +0000 (0:00:00.021) 0:00:16.237 ******
skipping: [instance]
TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
Thursday 09 October 2025 21:02:46 +0000 (0:00:00.016) 0:00:16.254 ******
skipping: [instance]
TASK [repo_setup : Cleanup existing metadata] **********************************
Thursday 09 October 2025 21:02:46 +0000 (0:00:00.028) 0:00:16.283 ******
skipping: [instance]
TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
Thursday 09 October 2025 21:02:46 +0000 (0:00:00.016) 0:00:16.299 ******
skipping: [instance]
TASK [test_deps : Look for redhat-release rpm] *********************************
Thursday 09 October 2025 21:02:46 +0000 (0:00:00.020) 0:00:16.320 ******
skipping: [instance]
TASK [test_deps : Remove redhat-release] ***************************************
Thursday 09 October 2025 21:02:46 +0000 (0:00:00.027) 0:00:16.347 ******
skipping: [instance]
TASK [test_deps : Install centos-stream-release] *******************************
Thursday 09 October 2025 21:02:46 +0000 (0:00:00.027) 0:00:16.375 ******
skipping: [instance]
TASK [test_deps : Install additional packages] *********************************
Thursday 09 October 2025 21:02:46 +0000 (0:00:00.026) 0:00:16.402 ******
skipping: [instance]
TASK [test_deps : Install selinux python libs] *********************************
Thursday 09 October 2025 21:02:46 +0000 (0:00:00.026) 0:00:16.429 ******
ok: [instance]
TASK [test_deps : Install python yaml libs] ************************************
Thursday 09 October 2025 21:03:31 +0000 (0:00:44.984) 0:01:01.413 ******
ok: [instance]
TASK [test_deps : Install extra packages] **************************************
Thursday 09 October 2025 21:03:32 +0000 (0:00:01.189) 0:01:02.603 ******
skipping: [instance]
TASK [ci_setup : Gather variables for each operating system] *******************
Thursday 09 October 2025 21:03:32 +0000 (0:00:00.041) 0:01:02.644 ******
ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
TASK [ci_setup : List packages to install] *************************************
Thursday 09 October 2025 21:03:32 +0000 (0:00:00.048) 0:01:02.692 ******
ok: [instance] =>
cifmw_ci_setup_packages:
- bash-completion
- ca-certificates
- git-core
- make
- tar
- tmux
- python3-pip
TASK [ci_setup : Install needed packages] **************************************
Thursday 09 October 2025 21:03:32 +0000 (0:00:00.021) 0:01:02.714 ******
changed: [instance]
TASK [ci_setup : Gather version of openshift client] ***************************
Thursday 09 October 2025 21:03:38 +0000 (0:00:05.635) 0:01:08.350 ******
ok: [instance]
TASK [ci_setup : Ensure openshift client install path is present] **************
Thursday 09 October 2025 21:03:38 +0000 (0:00:00.616) 0:01:08.966 ******
changed: [instance]
TASK [ci_setup : Install openshift client] *************************************
Thursday 09 October 2025 21:03:38 +0000 (0:00:00.228) 0:01:09.195 ******
changed: [instance]
TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
Thursday 09 October 2025 21:03:44 +0000 (0:00:06.030) 0:01:15.225 ******
ok: [instance]
TASK [ci_setup : Create completion file] ***************************************
Thursday 09 October 2025 21:03:45 +0000 (0:00:00.039) 0:01:15.265 ******
changed: [instance]
TASK [ci_setup : Source completion from within .bashrc] ************************
Thursday 09 October 2025 21:03:45 +0000 (0:00:00.269) 0:01:15.534 ******
changed: [instance]
TASK [ci_setup : Check rhsm status] ********************************************
Thursday 09 October 2025 21:03:45 +0000 (0:00:00.278) 0:01:15.813 ******
skipping: [instance]
TASK [ci_setup : Gather the repos to be enabled] *******************************
Thursday 09 October 2025 21:03:45 +0000 (0:00:00.020) 0:01:15.833 ******
skipping: [instance]
TASK [ci_setup : Enabling the required repositories.] **************************
Thursday 09 October 2025 21:03:45 +0000 (0:00:00.018) 0:01:15.851 ******
skipping: [instance]
TASK [ci_setup : Get current /etc/redhat-release] ******************************
Thursday 09 October 2025 21:03:45 +0000 (0:00:00.018) 0:01:15.870 ******
skipping: [instance]
TASK [ci_setup : Print current /etc/redhat-release] ****************************
Thursday 09 October 2025 21:03:45 +0000 (0:00:00.017) 0:01:15.887 ******
skipping: [instance]
TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
Thursday 09 October 2025 21:03:45 +0000 (0:00:00.036) 0:01:15.924 ******
skipping: [instance]
TASK [ci_setup : Manage directories] *******************************************
Thursday 09 October 2025 21:03:45 +0000 (0:00:00.023) 0:01:15.947 ******
changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
changed: [instance] => (item=/opt/basedir/logs)
ok: [instance] => (item=/opt/basedir/tmp)
changed: [instance] => (item=/opt/basedir/volumes)
changed: [instance] => (item=/opt/basedir/artifacts/parameters)
TASK [Create secret file] ******************************************************
Thursday 09 October 2025 21:03:46 +0000 (0:00:01.006) 0:01:16.954 ******
changed: [instance]
PLAY RECAP *********************************************************************
instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0
Thursday 09 October 2025 21:03:47 +0000 (0:00:00.336) 0:01:17.290 ******
===============================================================================
test_deps : Install selinux python libs -------------------------------- 44.98s
repo_setup : Initialize python venv and install requirements ------------ 7.61s
ci_setup : Install openshift client ------------------------------------- 6.03s
ci_setup : Install needed packages -------------------------------------- 5.64s
test_deps : Install python yaml libs ------------------------------------ 1.19s
repo_setup : Get repo-setup repository ---------------------------------- 1.17s
ci_setup : Manage directories ------------------------------------------- 1.01s
repo_setup : Run repo-setup --------------------------------------------- 0.84s
Gathering Facts --------------------------------------------------------- 0.83s
repo_setup : Make sure git-core package is installed -------------------- 0.78s
repo_setup : Install repo-setup package --------------------------------- 0.70s
test_deps : Disable ubi 9 repos ----------------------------------------- 0.68s
ci_setup : Gather version of openshift client --------------------------- 0.62s
repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s
repo_setup : Ensure directories are present ----------------------------- 0.52s
repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.42s
Create secret file ------------------------------------------------------ 0.34s
Create custom basedir --------------------------------------------------- 0.33s
ci_setup : Source completion from within .bashrc ------------------------ 0.28s
test_deps : Detect mirrors file ----------------------------------------- 0.28s
PLAY [Converge] ****************************************************************
TASK [Gathering Facts] *********************************************************
Thursday 09 October 2025 21:03:47 +0000 (0:00:00.025) 0:00:00.025 ******
ok: [instance]
TASK [Load networking definition from scenario file] ***************************
Thursday 09 October 2025 21:03:48 +0000 (0:00:00.818) 0:00:00.844 ******
ok: [instance]
TASK [discover_latest_image : Get latest image] ********************************
Thursday 09 October 2025 21:03:48 +0000 (0:00:00.023) 0:00:00.868 ******
changed: [instance]
TASK [discover_latest_image : Export facts accordingly] ************************
Thursday 09 October 2025 21:03:50 +0000 (0:00:01.882) 0:00:02.750 ******
ok: [instance]
TASK [reproducer : Load CI job environment] ************************************
Thursday 09 October 2025 21:03:50 +0000 (0:00:00.026) 0:00:02.777 ******
skipping: [instance]
TASK [reproducer : Discover and expose CI Framework path on remote node] *******
Thursday 09 October 2025 21:03:50 +0000 (0:00:00.020) 0:00:02.797 ******
ok: [instance]
TASK [Build final libvirt layout] **********************************************
Thursday 09 October 2025 21:03:50 +0000 (0:00:00.077) 0:00:02.874 ******
TASK [libvirt_manager : Chose right parameter for layout definition] ***********
Thursday 09 October 2025 21:03:50 +0000 (0:00:00.049) 0:00:02.924 ******
ok: [instance]
TASK [libvirt_manager : Patch the layout if needed] ****************************
Thursday 09 October 2025 21:03:50 +0000 (0:00:00.081) 0:00:03.005 ******
skipping: [instance]
TASK [reproducer : Assert no conflicting parameters were passed] ***************
Thursday 09 October 2025 21:03:50 +0000 (0:00:00.061) 0:00:03.066 ******
ok: [instance]
TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
Thursday 09 October 2025 21:03:50 +0000 (0:00:00.026) 0:00:03.093 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [reproducer : Set _use_crc based on actual layout] ************************
Thursday 09 October 2025 21:03:50 +0000 (0:00:00.024) 0:00:03.118 ******
ok: [instance]
TASK [reproducer : Ensure directories are present] *****************************
Thursday 09 October 2025 21:03:50 +0000 (0:00:00.044) 0:00:03.162 ******
ok: [instance] => (item=artifacts)
ok: [instance] => (item=logs)
TASK [Bootstrap libvirt if needed] *********************************************
Thursday 09 October 2025 21:03:51 +0000 (0:00:00.458) 0:00:03.621 ******
TASK [libvirt_manager : Ensure output directory exists] ************************
Thursday 09 October 2025 21:03:51 +0000 (0:00:00.076) 0:00:03.697 ******
ok: [instance]
TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
Thursday 09 October 2025 21:03:51 +0000 (0:00:00.191) 0:00:03.889 ******
changed: [instance]
TASK [libvirt_manager : Check if KVM is enabled] *******************************
Thursday 09 October 2025 21:03:51 +0000 (0:00:00.256) 0:00:04.145 ******
ok: [instance]
TASK [libvirt_manager : Fail if KVM not enabled] *******************************
Thursday 09 October 2025 21:03:52 +0000 (0:00:00.285) 0:00:04.431 ******
skipping: [instance]
TASK [libvirt_manager : Check if VMX virtualization] ***************************
Thursday 09 October 2025 21:03:52 +0000 (0:00:00.031) 0:00:04.462 ******
skipping: [instance]
TASK [libvirt_manager : Check if SVM virtualization] ***************************
Thursday 09 October 2025 21:03:52 +0000 (0:00:00.018) 0:00:04.480 ******
ok: [instance]
TASK [libvirt_manager : Enable VMX virtualization] *****************************
Thursday 09 October 2025 21:03:52 +0000 (0:00:00.021) 0:00:04.501 ******
skipping: [instance]
TASK [libvirt_manager : Install packages required for using KVM] ***************
Thursday 09 October 2025 21:03:52 +0000 (0:00:00.029) 0:00:04.531 ******
changed: [instance]
TASK [libvirt_manager : Create rules.d polkit folder] **************************
Thursday 09 October 2025 21:04:03 +0000 (0:00:11.644) 0:00:16.175 ******
changed: [instance]
TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
Thursday 09 October 2025 21:04:04 +0000 (0:00:00.224) 0:00:16.399 ******
changed: [instance]
TASK [libvirt_manager : Restart service polkit service] ************************
Thursday 09 October 2025 21:04:04 +0000 (0:00:00.526) 0:00:16.926 ******
changed: [instance]
TASK [libvirt_manager : Remove directory for service override] *****************
Thursday 09 October 2025 21:04:05 +0000 (0:00:00.605) 0:00:17.531 ******
ok: [instance]
TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
Thursday 09 October 2025 21:04:05 +0000 (0:00:00.208) 0:00:17.740 ******
ok: [instance]
TASK [libvirt_manager : Ensure firewalld service is up] ************************
Thursday 09 October 2025 21:04:06 +0000 (0:00:00.697) 0:00:18.437 ******
changed: [instance]
TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
Thursday 09 October 2025 21:04:07 +0000 (0:00:00.979) 0:00:19.417 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
Thursday 09 October 2025 21:04:07 +0000 (0:00:00.085) 0:00:19.502 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
Thursday 09 October 2025 21:04:07 +0000 (0:00:00.361) 0:00:19.864 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
Thursday 09 October 2025 21:04:07 +0000 (0:00:00.357) 0:00:20.221 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
Thursday 09 October 2025 21:04:08 +0000 (0:00:00.353) 0:00:20.574 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
Thursday 09 October 2025 21:04:08 +0000 (0:00:00.339) 0:00:20.914 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
Thursday 09 October 2025 21:04:08 +0000 (0:00:00.334) 0:00:21.248 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
Thursday 09 October 2025 21:04:09 +0000 (0:00:00.345) 0:00:21.594 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
Thursday 09 October 2025 21:04:09 +0000 (0:00:00.349) 0:00:21.943 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
Thursday 09 October 2025 21:04:09 +0000 (0:00:00.338) 0:00:22.281 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
Thursday 09 October 2025 21:04:10 +0000 (0:00:00.330) 0:00:22.612 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
Thursday 09 October 2025 21:04:11 +0000 (0:00:01.338) 0:00:23.950 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
Thursday 09 October 2025 21:04:12 +0000 (0:00:00.399) 0:00:24.350 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
Thursday 09 October 2025 21:04:12 +0000 (0:00:00.349) 0:00:24.699 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
Thursday 09 October 2025 21:04:12 +0000 (0:00:00.342) 0:00:25.041 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
Thursday 09 October 2025 21:04:13 +0000 (0:00:00.344) 0:00:25.386 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
Thursday 09 October 2025 21:04:13 +0000 (0:00:00.366) 0:00:25.752 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
Thursday 09 October 2025 21:04:13 +0000 (0:00:00.340) 0:00:26.093 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
Thursday 09 October 2025 21:04:15 +0000 (0:00:01.344) 0:00:27.438 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
Thursday 09 October 2025 21:04:15 +0000 (0:00:00.337) 0:00:27.776 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
Thursday 09 October 2025 21:04:15 +0000 (0:00:00.334) 0:00:28.110 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
Thursday 09 October 2025 21:04:16 +0000 (0:00:00.336) 0:00:28.446 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
Thursday 09 October 2025 21:04:16 +0000 (0:00:00.332) 0:00:28.778 ******
ok: [instance]
TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
Thursday 09 October 2025 21:04:16 +0000 (0:00:00.333) 0:00:29.112 ******
ok: [instance]
TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
Thursday 09 October 2025 21:04:17 +0000 (0:00:00.337) 0:00:29.449 ******
ok: [instance]
TASK [libvirt_manager : Manage service for older releases] *********************
Thursday 09 October 2025 21:04:17 +0000 (0:00:00.337) 0:00:29.787 ******
skipping: [instance]
TASK [libvirt_manager : Get libvirt group users] *******************************
Thursday 09 October 2025 21:04:17 +0000 (0:00:00.028) 0:00:29.815 ******
ok: [instance]
TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
Thursday 09 October 2025 21:04:17 +0000 (0:00:00.306) 0:00:30.122 ******
ok: [instance]
TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
Thursday 09 October 2025 21:04:18 +0000 (0:00:00.386) 0:00:30.508 ******
changed: [instance]
TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
Thursday 09 October 2025 21:04:18 +0000 (0:00:00.315) 0:00:30.824 ******
[WARNING]: Reset is not implemented for this connection
changed: [instance]
TASK [libvirt_manager : Ensure we reload user env] *****************************
Thursday 09 October 2025 21:04:18 +0000 (0:00:00.291) 0:00:31.115 ******
TASK [reproducer : Deploy networks in libvirt] *********************************
Thursday 09 October 2025 21:04:18 +0000 (0:00:00.016) 0:00:31.131 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
TASK [reproducer : Ensure networks are consistent] *****************************
Thursday 09 October 2025 21:04:18 +0000 (0:00:00.075) 0:00:31.207 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
TASK [reproducer : Ensure all VM types have defined nets parameter] ************
Thursday 09 October 2025 21:04:18 +0000 (0:00:00.042) 0:00:31.249 ******
ok: [instance] => (item=compute)
ok: [instance] => (item=controller)
ok: [instance] => (item=crc)
TASK [reproducer : Ensure all standard attached networks are defined] **********
Thursday 09 October 2025 21:04:18 +0000 (0:00:00.048) 0:00:31.297 ******
ok: [instance]
TASK [reproducer : Ensure we don't have extra network defined] *****************
Thursday 09 October 2025 21:04:18 +0000 (0:00:00.041) 0:00:31.339 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [Ensure we get latest OCP config] *****************************************
Thursday 09 October 2025 21:04:19 +0000 (0:00:00.047) 0:00:31.386 ******
TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
Thursday 09 October 2025 21:04:19 +0000 (0:00:00.042) 0:00:31.429 ******
ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
ok: [instance] => (item={})
TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
Thursday 09 October 2025 21:04:19 +0000 (0:00:00.074) 0:00:31.503 ******
skipping: [instance]
TASK [devscripts : Ensure output directory exists] *****************************
Thursday 09 October 2025 21:04:19 +0000 (0:00:00.018) 0:00:31.522 ******
ok: [instance]
TASK [devscripts : Output built config for easier debugging] *******************
Thursday 09 October 2025 21:04:19 +0000 (0:00:00.236) 0:00:31.758 ******
changed: [instance]
TASK [ci_network : Remove the local dns configuration] *************************
Thursday 09 October 2025 21:04:19 +0000 (0:00:00.376) 0:00:32.135 ******
ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
TASK [ci_network : Reload the NetworkManager to pick the changes] **************
Thursday 09 October 2025 21:04:20 +0000 (0:00:00.802) 0:00:32.938 ******
skipping: [instance]
TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
Thursday 09 October 2025 21:04:20 +0000 (0:00:00.034) 0:00:32.972 ******
changed: [instance]
TASK [reproducer : Flush handlers for NetworkManager restart] ******************
Thursday 09 October 2025 21:04:21 +0000 (0:00:00.384) 0:00:33.357 ******
RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
Thursday 09 October 2025 21:04:21 +0000 (0:00:00.008) 0:00:33.365 ******
changed: [instance]
TASK [Ensure no default networks exists] ***************************************
Thursday 09 October 2025 21:04:21 +0000 (0:00:00.441) 0:00:33.806 ******
TASK [libvirt_manager : Deactivate crc] ****************************************
Thursday 09 October 2025 21:04:21 +0000 (0:00:00.078) 0:00:33.885 ******
ok: [instance]
TASK [libvirt_manager : Removing crc] ******************************************
Thursday 09 October 2025 21:04:22 +0000 (0:00:01.247) 0:00:35.132 ******
ok: [instance]
TASK [libvirt_manager : Deactivate default] ************************************
Thursday 09 October 2025 21:04:23 +0000 (0:00:00.266) 0:00:35.398 ******
ok: [instance]
TASK [libvirt_manager : Removing default] **************************************
Thursday 09 October 2025 21:04:23 +0000 (0:00:00.534) 0:00:35.933 ******
ok: [instance]
TASK [reproducer : Ensure firewalld is installed] ******************************
Thursday 09 October 2025 21:04:23 +0000 (0:00:00.256) 0:00:36.189 ******
ok: [instance]
TASK [reproducer : Ensure firewalld service is enabled and started] ************
Thursday 09 October 2025 21:04:25 +0000 (0:00:01.221) 0:00:37.411 ******
ok: [instance]
TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
Thursday 09 October 2025 21:04:25 +0000 (0:00:00.335) 0:00:37.746 ******
changed: [instance]
TASK [reproducer : Ensure IP forwarding is enabled] ****************************
Thursday 09 October 2025 21:04:25 +0000 (0:00:00.347) 0:00:38.093 ******
changed: [instance]
TASK [reproducer : Ensure the required parameters are loaded] ******************
Thursday 09 October 2025 21:04:26 +0000 (0:00:00.345) 0:00:38.439 ******
changed: [instance] => (item=arptables)
changed: [instance] => (item=iptables)
changed: [instance] => (item=ip6tables)
TASK [reproducer : Ensure firewall service is enabled and started] *************
Thursday 09 October 2025 21:04:28 +0000 (0:00:02.628) 0:00:41.068 ******
ok: [instance]
TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.336) 0:00:41.404 ******
ok: [instance]
TASK [Ensure the required network configurations are applied] ******************
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.094) 0:00:41.498 ******
TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.047) 0:00:41.545 ******
skipping: [instance]
TASK [networking_mapper : Check for Networking Definition file existance] ******
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.025) 0:00:41.571 ******
skipping: [instance]
TASK [networking_mapper : Load the Networking Definition from file] ************
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.024) 0:00:41.596 ******
skipping: [instance]
TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.023) 0:00:41.620 ******
skipping: [instance]
TASK [ci_nmstate : Initialize NMstates for each instance] **********************
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.030) 0:00:41.650 ******
ok: [instance]
TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.039) 0:00:41.689 ******
skipping: [instance]
TASK [ci_nmstate : Get k8s nodes] **********************************************
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.035) 0:00:41.725 ******
skipping: [instance]
TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.026) 0:00:41.751 ******
ok: [instance]
TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.065) 0:00:41.816 ******
skipping: [instance]
TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.028) 0:00:41.845 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
TASK [ci_nmstate : Ensure we have needed facts] ********************************
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.052) 0:00:41.898 ******
ok: [instance -> localhost]
TASK [ci_nmstate : Install required packages on localhost] *********************
Thursday 09 October 2025 21:04:29 +0000 (0:00:00.348) 0:00:42.246 ******
changed: [instance -> localhost]
TASK [ci_nmstate : Create the target NMstate dump directory] *******************
Thursday 09 October 2025 21:04:35 +0000 (0:00:05.146) 0:00:47.393 ******
changed: [instance]
TASK [ci_nmstate : Save nmstate state for localhost] ***************************
Thursday 09 October 2025 21:04:35 +0000 (0:00:00.234) 0:00:47.627 ******
changed: [instance]
TASK [ci_nmstate : Apply the desidered state on localhost] *********************
Thursday 09 October 2025 21:04:35 +0000 (0:00:00.358) 0:00:47.986 ******
changed: [instance -> localhost]
TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
Thursday 09 October 2025 21:04:37 +0000 (0:00:01.627) 0:00:49.613 ******
changed: [instance]
TASK [reproducer : Select right domain] ****************************************
Thursday 09 October 2025 21:04:37 +0000 (0:00:00.412) 0:00:50.026 ******
ok: [instance]
TASK [Create the virtual networks] *********************************************
Thursday 09 October 2025 21:04:37 +0000 (0:00:00.037) 0:00:50.063 ******
TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
Thursday 09 October 2025 21:04:37 +0000 (0:00:00.118) 0:00:50.182 ******
ok: [instance]
TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
Thursday 09 October 2025 21:04:37 +0000 (0:00:00.020) 0:00:50.203 ******
ok: [instance]
TASK [libvirt_manager : Load file if exists] ***********************************
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.197) 0:00:50.401 ******
skipping: [instance]
TASK [libvirt_manager : Update fact with existing content] *********************
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.032) 0:00:50.433 ******
skipping: [instance]
TASK [libvirt_manager : Generate VM list] **************************************
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.032) 0:00:50.466 ******
ok: [instance]
TASK [libvirt_manager : Generate/update mapping all nodes] *********************
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.061) 0:00:50.528 ******
ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
TASK [libvirt_manager : Append baremetal nodes if needed] **********************
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.126) 0:00:50.654 ******
skipping: [instance]
TASK [libvirt_manager : Dump MAC mapping] **************************************
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.036) 0:00:50.691 ******
changed: [instance]
TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.365) 0:00:51.056 ******
changed: [instance] => (item=Adding compute-0 to computes)
changed: [instance] => (item=Adding controller-0 to controllers)
changed: [instance] => (item=Adding crc-0 to ocps)
TASK [networking_mapper : Check for Networking Definition file existence] ******
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.119) 0:00:51.176 ******
skipping: [instance]
TASK [networking_mapper : Load the Networking Definition from file] ************
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.023) 0:00:51.200 ******
skipping: [instance]
TASK [networking_mapper : Check for interfaces info file existence] ************
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.024) 0:00:51.225 ******
skipping: [instance]
TASK [networking_mapper : Load the interfaces info from file] ******************
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.025) 0:00:51.250 ******
skipping: [instance]
TASK [networking_mapper : Ensure local fact is empty] **************************
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.025) 0:00:51.276 ******
ok: [instance]
TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
Thursday 09 October 2025 21:04:38 +0000 (0:00:00.019) 0:00:51.296 ******
ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
TASK [networking_mapper : Gather facts if requested] ***************************
Thursday 09 October 2025 21:04:39 +0000 (0:00:00.077) 0:00:51.374 ******
skipping: [instance]
TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
Thursday 09 October 2025 21:04:39 +0000 (0:00:00.028) 0:00:51.403 ******
changed: [instance]
TASK [networking_mapper : Write the Networking Definition to file] *************
Thursday 09 October 2025 21:04:39 +0000 (0:00:00.209) 0:00:51.613 ******
changed: [instance]
TASK [networking_mapper : Call the networking mapper] **************************
Thursday 09 October 2025 21:04:39 +0000 (0:00:00.419) 0:00:52.032 ******
ok: [instance]
TASK [networking_mapper : Set networking mapper facts] *************************
Thursday 09 October 2025 21:04:39 +0000 (0:00:00.066) 0:00:52.098 ******
ok: [instance]
TASK [networking_mapper : Write the Networking Environment Definition to file] ***
Thursday 09 October 2025 21:04:39 +0000 (0:00:00.036) 0:00:52.134 ******
changed: [instance]
TASK [libvirt_manager : Manage networks if needed] *****************************
Thursday 09 October 2025 21:04:40 +0000 (0:00:00.394) 0:00:52.529 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
Thursday 09 October 2025 21:04:40 +0000 (0:00:00.083) 0:00:52.612 ******
ok: [instance] => (item=public)
ok: [instance] => (item=osp_trunk)
TASK [libvirt_manager : Ensure networks are defined] ***************************
Thursday 09 October 2025 21:04:40 +0000 (0:00:00.077) 0:00:52.690 ******
changed: [instance] => (item=cifmw-public)
changed: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Ensure networks are created/started] *******************
Thursday 09 October 2025 21:04:40 +0000 (0:00:00.475) 0:00:53.165 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Ensure networks are active] ****************************
Thursday 09 October 2025 21:04:41 +0000 (0:00:00.653) 0:00:53.819 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
Thursday 09 October 2025 21:04:41 +0000 (0:00:00.465) 0:00:54.284 ******
changed: [instance] => (item=cifmw-public)
changed: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
Thursday 09 October 2025 21:04:42 +0000 (0:00:00.467) 0:00:54.751 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
Thursday 09 October 2025 21:04:42 +0000 (0:00:00.070) 0:00:54.822 ******
ok: [instance]
TASK [libvirt_manager : Fetch bridges ports link info] *************************
Thursday 09 October 2025 21:04:42 +0000 (0:00:00.210) 0:00:55.032 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [Create dummy interfaces to ensure bridges are UP] ************************
Thursday 09 October 2025 21:04:43 +0000 (0:00:00.405) 0:00:55.438 ******
TASK [ci_nmstate : Ensure we have needed facts] ********************************
Thursday 09 October 2025 21:04:43 +0000 (0:00:00.071) 0:00:55.510 ******
skipping: [instance]
TASK [ci_nmstate : Install required packages on instance] **********************
Thursday 09 October 2025 21:04:43 +0000 (0:00:00.041) 0:00:55.551 ******
ok: [instance]
TASK [ci_nmstate : Create the target NMstate dump directory] *******************
Thursday 09 October 2025 21:04:44 +0000 (0:00:01.279) 0:00:56.830 ******
ok: [instance]
TASK [ci_nmstate : Save nmstate state for instance] ****************************
Thursday 09 October 2025 21:04:44 +0000 (0:00:00.211) 0:00:57.042 ******
changed: [instance]
TASK [ci_nmstate : Apply the desidered state on instance] **********************
Thursday 09 October 2025 21:04:45 +0000 (0:00:00.376) 0:00:57.418 ******
changed: [instance]
TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
Thursday 09 October 2025 21:04:46 +0000 (0:00:01.737) 0:00:59.156 ******
changed: [instance]
TASK [Create extra network configuration] **************************************
Thursday 09 October 2025 21:04:47 +0000 (0:00:00.357) 0:00:59.514 ******
skipping: [instance]
TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
Thursday 09 October 2025 21:04:47 +0000 (0:00:00.040) 0:00:59.554 ******
skipping: [instance]
TASK [libvirt_manager : Refresh networking facts on host] **********************
Thursday 09 October 2025 21:04:47 +0000 (0:00:00.034) 0:00:59.589 ******
ok: [instance]
TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
Thursday 09 October 2025 21:04:47 +0000 (0:00:00.459) 0:01:00.048 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [dnsmasq : Install needed packages] ***************************************
Thursday 09 October 2025 21:04:47 +0000 (0:00:00.149) 0:01:00.197 ******
ok: [instance]
TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
Thursday 09 October 2025 21:04:49 +0000 (0:00:01.201) 0:01:01.398 ******
changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
TASK [dnsmasq : Manage configuration directory] ********************************
Thursday 09 October 2025 21:04:52 +0000 (0:00:03.838) 0:01:05.237 ******
changed: [instance]
TASK [dnsmasq : Manage systemd unit file] **************************************
Thursday 09 October 2025 21:04:53 +0000 (0:00:00.230) 0:01:05.468 ******
changed: [instance]
TASK [dnsmasq : Manage base configuration file] ********************************
Thursday 09 October 2025 21:04:53 +0000 (0:00:00.371) 0:01:05.839 ******
changed: [instance]
TASK [dnsmasq : Render listener configuration] *********************************
Thursday 09 October 2025 21:04:53 +0000 (0:00:00.417) 0:01:06.256 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
TASK [dnsmasq : Create listener configuration file] ****************************
Thursday 09 October 2025 21:04:53 +0000 (0:00:00.035) 0:01:06.292 ******
changed: [instance]
TASK [dnsmasq : Remove listener configuration file] ****************************
Thursday 09 October 2025 21:04:54 +0000 (0:00:00.433) 0:01:06.725 ******
skipping: [instance]
TASK [dnsmasq : Render dns configuration] **************************************
Thursday 09 October 2025 21:04:54 +0000 (0:00:00.022) 0:01:06.748 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
TASK [dnsmasq : Create dns configuration file] *********************************
Thursday 09 October 2025 21:04:54 +0000 (0:00:00.037) 0:01:06.785 ******
changed: [instance]
TASK [dnsmasq : Remove dns configuration file] *********************************
Thursday 09 October 2025 21:04:54 +0000 (0:00:00.423) 0:01:07.208 ******
skipping: [instance]
TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
Thursday 09 October 2025 21:04:54 +0000 (0:00:00.023) 0:01:07.232 ******
ok: [instance] => (item=127.0.0.2)
TASK [dnsmasq : Enable and start service] **************************************
Thursday 09 October 2025 21:04:55 +0000 (0:00:00.250) 0:01:07.483 ******
changed: [instance]
TASK [dnsmasq : Stop service] **************************************************
Thursday 09 October 2025 21:04:55 +0000 (0:00:00.726) 0:01:08.209 ******
skipping: [instance]
TASK [dnsmasq : Remove unit file] **********************************************
Thursday 09 October 2025 21:04:55 +0000 (0:00:00.023) 0:01:08.233 ******
skipping: [instance]
TASK [dnsmasq : Remove main configuration files] *******************************
Thursday 09 October 2025 21:04:55 +0000 (0:00:00.021) 0:01:08.254 ******
skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
skipping: [instance]
TASK [Create dnsmasq networks] *************************************************
Thursday 09 October 2025 21:04:55 +0000 (0:00:00.032) 0:01:08.287 ******
TASK [dnsmasq : Assert mandatory parameter] ************************************
Thursday 09 October 2025 21:04:56 +0000 (0:00:00.119) 0:01:08.407 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [dnsmasq : Assert mandatory parameters for new network] *******************
Thursday 09 October 2025 21:04:56 +0000 (0:00:00.038) 0:01:08.445 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [dnsmasq : Create network] ************************************************
Thursday 09 October 2025 21:04:56 +0000 (0:00:00.043) 0:01:08.489 ******
changed: [instance]
TASK [dnsmasq : Remove network] ************************************************
Thursday 09 October 2025 21:04:56 +0000 (0:00:00.489) 0:01:08.978 ******
skipping: [instance]
TASK [dnsmasq : Remove dhcp host files] ****************************************
Thursday 09 October 2025 21:04:56 +0000 (0:00:00.025) 0:01:09.004 ******
skipping: [instance]
TASK [dnsmasq : Assert mandatory parameter] ************************************
Thursday 09 October 2025 21:04:56 +0000 (0:00:00.030) 0:01:09.035 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [dnsmasq : Assert mandatory parameters for new network] *******************
Thursday 09 October 2025 21:04:56 +0000 (0:00:00.038) 0:01:09.073 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [dnsmasq : Create network] ************************************************
Thursday 09 October 2025 21:04:56 +0000 (0:00:00.046) 0:01:09.119 ******
changed: [instance]
TASK [dnsmasq : Remove network] ************************************************
Thursday 09 October 2025 21:04:57 +0000 (0:00:00.453) 0:01:09.573 ******
skipping: [instance]
TASK [dnsmasq : Remove dhcp host files] ****************************************
Thursday 09 October 2025 21:04:57 +0000 (0:00:00.026) 0:01:09.599 ******
skipping: [instance]
TASK [libvirt_manager : Ensure network is in correct zone] *********************
Thursday 09 October 2025 21:04:57 +0000 (0:00:00.032) 0:01:09.631 ******
changed: [instance] => (item=cifmw-public)
changed: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Extract IP address from network bridges] ***************
Thursday 09 October 2025 21:04:57 +0000 (0:00:00.544) 0:01:10.176 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Extract IP address from network bridges] ***************
Thursday 09 October 2025 21:04:57 +0000 (0:00:00.040) 0:01:10.216 ******
ok: [instance]
TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
Thursday 09 October 2025 21:04:58 +0000 (0:00:00.355) 0:01:10.571 ******
ok: [instance]
TASK [libvirt_manager : Extract IP address from network bridges] ***************
Thursday 09 October 2025 21:04:58 +0000 (0:00:00.040) 0:01:10.611 ******
ok: [instance]
TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
Thursday 09 October 2025 21:04:58 +0000 (0:00:00.214) 0:01:10.826 ******
ok: [instance]
TASK [libvirt_manager : Output _network_data] **********************************
Thursday 09 October 2025 21:04:58 +0000 (0:00:00.038) 0:01:10.865 ******
changed: [instance]
TASK [libvirt_manager : Output pub_net] ****************************************
Thursday 09 October 2025 21:04:58 +0000 (0:00:00.367) 0:01:11.232 ******
changed: [instance]
TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
Thursday 09 October 2025 21:04:59 +0000 (0:00:00.369) 0:01:11.601 ******
changed: [instance]
TASK [libvirt_manager : Expose patch for networking_mapper] ********************
Thursday 09 October 2025 21:04:59 +0000 (0:00:00.368) 0:01:11.970 ******
ok: [instance]
TASK [libvirt_manager : Save networking_mapper patch] **************************
Thursday 09 October 2025 21:04:59 +0000 (0:00:00.128) 0:01:12.099 ******
changed: [instance]
TASK [networking_mapper : Check for Networking Definition file existence] ******
Thursday 09 October 2025 21:05:00 +0000 (0:00:00.362) 0:01:12.461 ******
skipping: [instance]
TASK [networking_mapper : Load the Networking Definition from file] ************
Thursday 09 October 2025 21:05:00 +0000 (0:00:00.028) 0:01:12.490 ******
skipping: [instance]
TASK [networking_mapper : Check for interfaces info file existence] ************
Thursday 09 October 2025 21:05:00 +0000 (0:00:00.026) 0:01:12.517 ******
skipping: [instance]
TASK [networking_mapper : Load the interfaces info from file] ******************
Thursday 09 October 2025 21:05:00 +0000 (0:00:00.026) 0:01:12.543 ******
skipping: [instance]
TASK [networking_mapper : Ensure local fact is empty] **************************
Thursday 09 October 2025 21:05:00 +0000 (0:00:00.025) 0:01:12.569 ******
ok: [instance]
TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
Thursday 09 October 2025 21:05:00 +0000 (0:00:00.020) 0:01:12.589 ******
ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
TASK [networking_mapper : Gather facts if requested] ***************************
Thursday 09 October 2025 21:05:00 +0000 (0:00:00.122) 0:01:12.711 ******
skipping: [instance]
TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
Thursday 09 October 2025 21:05:00 +0000 (0:00:00.022) 0:01:12.733 ******
ok: [instance]
TASK [networking_mapper : Write the Networking Definition to file] *************
Thursday 09 October 2025 21:05:00 +0000 (0:00:00.219) 0:01:12.953 ******
changed: [instance]
TASK [networking_mapper : Call the networking mapper] **************************
Thursday 09 October 2025 21:05:01 +0000 (0:00:00.449) 0:01:13.402 ******
ok: [instance]
TASK [networking_mapper : Set networking mapper facts] *************************
Thursday 09 October 2025 21:05:01 +0000 (0:00:00.068) 0:01:13.471 ******
ok: [instance]
TASK [networking_mapper : Write the Networking Environment Definition to file] ***
Thursday 09 October 2025 21:05:01 +0000 (0:00:00.039) 0:01:13.510 ******
changed: [instance]
TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
Thursday 09 October 2025 21:05:01 +0000 (0:00:00.450) 0:01:13.961 ******
ok: [instance]
TASK [libvirt_manager : Unset patch] *******************************************
Thursday 09 October 2025 21:05:01 +0000 (0:00:00.037) 0:01:13.998 ******
ok: [instance]
TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
Thursday 09 October 2025 21:05:01 +0000 (0:00:00.030) 0:01:14.028 ******
ok: [instance]
TASK [libvirt_manager : Reserve IPs on networks] *******************************
Thursday 09 October 2025 21:05:01 +0000 (0:00:00.026) 0:01:14.054 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
TASK [libvirt_manager : Loop on host IPs] **************************************
Thursday 09 October 2025 21:05:01 +0000 (0:00:00.083) 0:01:14.138 ******
ok: [instance] => (item=compute-0 - ctlplane)
ok: [instance] => (item=controller-0 - ctlplane)
ok: [instance] => (item=crc-0 - ctlplane)
TASK [libvirt_manager : Loop on host IPs] **************************************
Thursday 09 October 2025 21:05:01 +0000 (0:00:00.133) 0:01:14.271 ******
skipping: [instance] => (item=compute-0 - internalapi)
skipping: [instance] => (item=controller-0 - internalapi)
skipping: [instance] => (item=crc-0 - internalapi)
skipping: [instance]
TASK [libvirt_manager : Loop on host IPs] **************************************
Thursday 09 October 2025 21:05:02 +0000 (0:00:00.089) 0:01:14.361 ******
skipping: [instance] => (item=compute-0 - storage)
skipping: [instance] => (item=controller-0 - storage)
skipping: [instance] => (item=crc-0 - storage)
skipping: [instance]
TASK [libvirt_manager : Loop on host IPs] **************************************
Thursday 09 October 2025 21:05:02 +0000 (0:00:00.086) 0:01:14.448 ******
skipping: [instance] => (item=compute-0 - tenant)
skipping: [instance] => (item=controller-0 - tenant)
skipping: [instance] => (item=crc-0 - tenant)
skipping: [instance]
TASK [libvirt_manager : Loop on host IPs] **************************************
Thursday 09 October 2025 21:05:02 +0000 (0:00:00.089) 0:01:14.537 ******
skipping: [instance] => (item=compute-0 - external)
skipping: [instance] => (item=controller-0 - external)
skipping: [instance] => (item=crc-0 - external)
skipping: [instance]
TASK [libvirt_manager : Loop on host IPs] **************************************
Thursday 09 October 2025 21:05:02 +0000 (0:00:00.086) 0:01:14.623 ******
skipping: [instance] => (item=compute-0 - storagemgmt)
skipping: [instance] => (item=controller-0 - storagemgmt)
skipping: [instance] => (item=crc-0 - storagemgmt)
skipping: [instance]
TASK [libvirt_manager : Loop on host IPs] **************************************
Thursday 09 October 2025 21:05:02 +0000 (0:00:00.086) 0:01:14.710 ******
ok: [instance] => (item=compute-0 - public)
ok: [instance] => (item=controller-0 - public)
ok: [instance] => (item=crc-0 - public)
TASK [Inject DHCP entries for net {{ net_name }}] ******************************
Thursday 09 October 2025 21:05:02 +0000 (0:00:00.135) 0:01:14.846 ******
TASK [dnsmasq : Ensure we have the right data and type] ************************
Thursday 09 October 2025 21:05:02 +0000 (0:00:00.117) 0:01:14.963 ******
ok: [instance]
TASK [dnsmasq : Assert we have needed host data] *******************************
Thursday 09 October 2025 21:05:02 +0000 (0:00:00.046) 0:01:15.010 ******
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:8c:a6:a2', 'ips': ['192.168.140.100', '']})
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:b1:f6:b3', 'ips': ['192.168.140.9', '']})
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:c3:23:81', 'ips': ['192.168.140.10', '']})
ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:65:9a:33', 'ips': ['192.168.101.100', '']})
ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:3c:58:1b', 'ips': ['192.168.101.9', '']})
ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:cf:9b:f3', 'ips': ['192.168.101.10', '']})
TASK [dnsmasq : Ensure networks exists] ****************************************
Thursday 09 October 2025 21:05:02 +0000 (0:00:00.106) 0:01:15.117 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
TASK [dnsmasq : Check network file status] *************************************
Thursday 09 October 2025 21:05:02 +0000 (0:00:00.058) 0:01:15.175 ******
ok: [instance]
TASK [dnsmasq : Assert network exists] *****************************************
Thursday 09 October 2025 21:05:03 +0000 (0:00:00.194) 0:01:15.370 ******
ok: [instance]
TASK [dnsmasq : Check network file status] *************************************
Thursday 09 October 2025 21:05:03 +0000 (0:00:00.029) 0:01:15.399 ******
ok: [instance]
TASK [dnsmasq : Assert network exists] *****************************************
Thursday 09 October 2025 21:05:03 +0000 (0:00:00.191) 0:01:15.591 ******
ok: [instance]
TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
Thursday 09 October 2025 21:05:03 +0000 (0:00:00.031) 0:01:15.622 ******
ok: [instance]
TASK [dnsmasq : Compute entry] *************************************************
Thursday 09 October 2025 21:05:03 +0000 (0:00:00.024) 0:01:15.647 ******
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:8c:a6:a2', 'ips': ['192.168.140.100', '']})
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:b1:f6:b3', 'ips': ['192.168.140.9', '']})
ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:c3:23:81', 'ips': ['192.168.140.10', '']})
ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:65:9a:33', 'ips': ['192.168.101.100', '']})
ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:3c:58:1b', 'ips': ['192.168.101.9', '']})
ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:cf:9b:f3', 'ips': ['192.168.101.10', '']})
TASK [dnsmasq : Create add/remove sets] ****************************************
Thursday 09 October 2025 21:05:03 +0000 (0:00:00.176) 0:01:15.823 ******
ok: [instance]
TASK [dnsmasq : Add DHCP entries] **********************************************
Thursday 09 October 2025 21:05:03 +0000 (0:00:00.043) 0:01:15.867 ******
changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:8c:a6:a2', 'entry': '52:54:00:8c:a6:a2,192.168.140.100,compute-0', 'state': 'present'})
changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:b1:f6:b3', 'entry': '52:54:01:b1:f6:b3,192.168.140.9,controller-0', 'state': 'present'})
changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:c3:23:81', 'entry': '52:54:02:c3:23:81,192.168.140.10,crc-0', 'state': 'present'})
changed: [instance] => (item={'file': 'public_compute-0_52:54:00:65:9a:33', 'entry': '52:54:00:65:9a:33,192.168.101.100,compute-0', 'state': 'present'})
changed: [instance] => (item={'file': 'public_controller-0_52:54:01:3c:58:1b', 'entry': '52:54:01:3c:58:1b,192.168.101.9,controller-0', 'state': 'present'})
changed: [instance] => (item={'file': 'public_crc-0_52:54:02:cf:9b:f3', 'entry': '52:54:02:cf:9b:f3,192.168.101.10,crc-0', 'state': 'present'})
TASK [dnsmasq : Remove DHCP entries] *******************************************
Thursday 09 October 2025 21:05:05 +0000 (0:00:02.194) 0:01:18.062 ******
skipping: [instance]
TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
Thursday 09 October 2025 21:05:05 +0000 (0:00:00.029) 0:01:18.092 ******
ok: [instance] => (item=compute-0)
ok: [instance] => (item=controller-0)
ok: [instance] => (item=crc-0)
TASK [Inject VMs in the .utility zone] *****************************************
Thursday 09 October 2025 21:05:05 +0000 (0:00:00.230) 0:01:18.322 ******
TASK [dnsmasq : Assert we have needed host record data] ************************
Thursday 09 October 2025 21:05:06 +0000 (0:00:00.119) 0:01:18.442 ******
ok: [instance]
TASK [dnsmasq : Assert each address element have needed data] ******************
Thursday 09 October 2025 21:05:06 +0000 (0:00:00.128) 0:01:18.571 ******
ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
TASK [dnsmasq : Add/Remove address] ********************************************
Thursday 09 October 2025 21:05:06 +0000 (0:00:00.204) 0:01:18.776 ******
changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
TASK [libvirt_manager : Ensure some domains are local] *************************
Thursday 09 October 2025 21:05:09 +0000 (0:00:03.283) 0:01:22.060 ******
changed: [instance]
TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
Thursday 09 October 2025 21:05:10 +0000 (0:00:00.375) 0:01:22.435 ******
RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
Thursday 09 October 2025 21:05:10 +0000 (0:00:00.011) 0:01:22.446 ******
changed: [instance]
RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
Thursday 09 October 2025 21:05:10 +0000 (0:00:00.815) 0:01:23.262 ******
changed: [instance]
RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
Thursday 09 October 2025 21:05:11 +0000 (0:00:00.359) 0:01:23.621 ******
changed: [instance]
TASK [reproducer : Delegate our domains to our own instance] *******************
Thursday 09 October 2025 21:05:11 +0000 (0:00:00.345) 0:01:23.967 ******
changed: [instance]
TASK [reproducer : Ensure "utility" domain is local] ***************************
Thursday 09 October 2025 21:05:11 +0000 (0:00:00.362) 0:01:24.330 ******
changed: [instance]
TASK [Build utility records dataset] *******************************************
Thursday 09 October 2025 21:05:12 +0000 (0:00:00.369) 0:01:24.699 ******
TASK [dnsmasq : Assert we have needed host record data] ************************
Thursday 09 October 2025 21:05:12 +0000 (0:00:00.031) 0:01:24.731 ******
ok: [instance]
TASK [dnsmasq : Assert each address element have needed data] ******************
Thursday 09 October 2025 21:05:12 +0000 (0:00:00.093) 0:01:24.824 ******
ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
TASK [dnsmasq : Add/Remove address] ********************************************
Thursday 09 October 2025 21:05:12 +0000 (0:00:00.103) 0:01:24.927 ******
changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
TASK [reproducer : Flush handlers] *********************************************
Thursday 09 October 2025 21:05:13 +0000 (0:00:00.471) 0:01:25.399 ******
RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
Thursday 09 October 2025 21:05:13 +0000 (0:00:00.010) 0:01:25.409 ******
changed: [instance]
RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
Thursday 09 October 2025 21:05:13 +0000 (0:00:00.480) 0:01:25.889 ******
changed: [instance]
TASK [reproducer : Bootstrap nat64 if needed] **********************************
Thursday 09 October 2025 21:05:14 +0000 (0:00:01.388) 0:01:27.278 ******
skipping: [instance]
TASK [reproducer : Deploy CRC if needed] ***************************************
Thursday 09 October 2025 21:05:14 +0000 (0:00:00.036) 0:01:27.314 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
TASK [reproducer : Check for CRC availability in known path] *******************
Thursday 09 October 2025 21:05:15 +0000 (0:00:00.111) 0:01:27.426 ******
ok: [instance]
TASK [Deploy CRC if needed] ****************************************************
Thursday 09 October 2025 21:05:15 +0000 (0:00:00.194) 0:01:27.620 ******
skipping: [instance]
TASK [rhol_crc : Stop CRC VM] **************************************************
Thursday 09 October 2025 21:05:15 +0000 (0:00:00.022) 0:01:27.643 ******
ok: [instance]
TASK [rhol_crc : Undefine CRC VM] **********************************************
Thursday 09 October 2025 21:05:15 +0000 (0:00:00.367) 0:01:28.011 ******
ok: [instance]
TASK [rhol_crc : Destroy CRC network] ******************************************
Thursday 09 October 2025 21:05:15 +0000 (0:00:00.245) 0:01:28.257 ******
ok: [instance]
TASK [rhol_crc : Undefine CRC network] *****************************************
Thursday 09 October 2025 21:05:16 +0000 (0:00:00.225) 0:01:28.482 ******
ok: [instance]
TASK [rhol_crc : Destroy default network] **************************************
Thursday 09 October 2025 21:05:16 +0000 (0:00:00.225) 0:01:28.708 ******
ok: [instance]
TASK [Check if new ssh keypair exists] *****************************************
Thursday 09 October 2025 21:05:16 +0000 (0:00:00.234) 0:01:28.942 ******
TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
Thursday 09 October 2025 21:05:16 +0000 (0:00:00.042) 0:01:28.985 ******
ok: [instance]
TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
Thursday 09 October 2025 21:05:16 +0000 (0:00:00.199) 0:01:29.185 ******
ok: [instance]
TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
Thursday 09 October 2025 21:05:16 +0000 (0:00:00.023) 0:01:29.209 ******
skipping: [instance]
TASK [reproducer : Slurp ssh key for CRC access] *******************************
Thursday 09 October 2025 21:05:16 +0000 (0:00:00.025) 0:01:29.234 ******
ok: [instance]
TASK [reproducer : Get kubeconfig file from crc directory] *********************
Thursday 09 October 2025 21:05:17 +0000 (0:00:00.260) 0:01:29.494 ******
ok: [instance]
TASK [reproducer : Get kubeadmin-password file from crc directory] *************
Thursday 09 October 2025 21:05:17 +0000 (0:00:00.225) 0:01:29.719 ******
ok: [instance]
TASK [Ensure we expose openshift_login related facts] **************************
Thursday 09 October 2025 21:05:17 +0000 (0:00:00.183) 0:01:29.902 ******
TASK [openshift_login : Assert we have needed parameters] **********************
Thursday 09 October 2025 21:05:17 +0000 (0:00:00.060) 0:01:29.963 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [openshift_login : Stat kubeconfig] ***************************************
Thursday 09 October 2025 21:05:17 +0000 (0:00:00.044) 0:01:30.007 ******
ok: [instance]
TASK [openshift_login : Stat kubeadmin] ****************************************
Thursday 09 October 2025 21:05:17 +0000 (0:00:00.179) 0:01:30.186 ******
ok: [instance]
TASK [openshift_login : Assert files exist] ************************************
Thursday 09 October 2025 21:05:18 +0000 (0:00:00.195) 0:01:30.382 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [openshift_login : Gather the password of the deployed cluster.] **********
Thursday 09 October 2025 21:05:18 +0000 (0:00:00.025) 0:01:30.407 ******
ok: [instance]
TASK [openshift_login : Gather the deployed OCP configuration.] ****************
Thursday 09 October 2025 21:05:18 +0000 (0:00:00.192) 0:01:30.600 ******
ok: [instance]
TASK [openshift_login : Set the OpenShift platform access information.] ********
Thursday 09 October 2025 21:05:18 +0000 (0:00:00.179) 0:01:30.780 ******
ok: [instance]
TASK [reproducer : Remove CRC managed zone delegation] *************************
Thursday 09 October 2025 21:05:18 +0000 (0:00:00.050) 0:01:30.831 ******
changed: [instance] => (item=dnsmasq.d/crc.conf)
changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
Thursday 09 October 2025 21:05:18 +0000 (0:00:00.404) 0:01:31.236 ******
skipping: [instance]
TASK [Load the architecture local kustomize patches] ***************************
Thursday 09 October 2025 21:05:18 +0000 (0:00:00.025) 0:01:31.262 ******
skipping: [instance]
TASK [reproducer : Consume libvirt_manager] ************************************
Thursday 09 October 2025 21:05:18 +0000 (0:00:00.035) 0:01:31.298 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
TASK [libvirt_manager : Import layout generator if needed] *********************
Thursday 09 October 2025 21:05:19 +0000 (0:00:00.135) 0:01:31.433 ******
skipping: [instance]
TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
Thursday 09 October 2025 21:05:19 +0000 (0:00:00.035) 0:01:31.469 ******
changed: [instance]
TASK [libvirt_manager : Enable masquerading for public traffic] ****************
Thursday 09 October 2025 21:05:19 +0000 (0:00:00.434) 0:01:31.904 ******
changed: [instance]
TASK [libvirt_manager : Ensure firewalld is restarts] **************************
Thursday 09 October 2025 21:05:20 +0000 (0:00:00.583) 0:01:32.487 ******
RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
Thursday 09 October 2025 21:05:20 +0000 (0:00:00.011) 0:01:32.499 ******
changed: [instance]
RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
Thursday 09 October 2025 21:05:20 +0000 (0:00:00.436) 0:01:32.935 ******
changed: [instance]
TASK [Deploy virtualbmc] *******************************************************
Thursday 09 October 2025 21:05:21 +0000 (0:00:00.864) 0:01:33.799 ******
skipping: [instance]
TASK [libvirt_manager : Let the project know we have vbmc available] ***********
Thursday 09 October 2025 21:05:21 +0000 (0:00:00.035) 0:01:33.835 ******
skipping: [instance]
TASK [libvirt_manager : Create needed workload directory] **********************
Thursday 09 October 2025 21:05:21 +0000 (0:00:00.035) 0:01:33.871 ******
changed: [instance] => (item=workload)
changed: [instance] => (item=reproducer-inventory)
ok: [instance] => (item=volumes)
TASK [libvirt_manager : Allow QEMU on workload directory] **********************
Thursday 09 October 2025 21:05:22 +0000 (0:00:00.585) 0:01:34.456 ******
changed: [instance] => (item=workload)
changed: [instance] => (item=volumes)
TASK [libvirt_manager : Generate networking data] ******************************
Thursday 09 October 2025 21:05:22 +0000 (0:00:00.467) 0:01:34.924 ******
skipping: [instance]
TASK [libvirt_manager : Create group inventories] ******************************
Thursday 09 October 2025 21:05:22 +0000 (0:00:00.028) 0:01:34.953 ******
changed: [instance] => (item=compute)
changed: [instance] => (item=controller)
changed: [instance] => (item=crc)
TASK [libvirt_manager : Create "all" group inventory file] *********************
Thursday 09 October 2025 21:05:23 +0000 (0:00:01.043) 0:01:35.996 ******
changed: [instance]
TASK [libvirt_manager : Ensure storage pool is present.] ***********************
Thursday 09 October 2025 21:05:24 +0000 (0:00:00.372) 0:01:36.369 ******
skipping: [instance]
TASK [libvirt_manager : Ensure images are present] *****************************
Thursday 09 October 2025 21:05:24 +0000 (0:00:00.039) 0:01:36.408 ******
skipping: [instance] => (item=crc)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
TASK [libvirt_manager : Ensure directory exists] *******************************
Thursday 09 October 2025 21:05:24 +0000 (0:00:00.063) 0:01:36.471 ******
changed: [instance]
TASK [libvirt_manager : Check if base image exists] ****************************
Thursday 09 October 2025 21:05:24 +0000 (0:00:00.207) 0:01:36.679 ******
ok: [instance]
TASK [libvirt_manager : Download base image] ***********************************
Thursday 09 October 2025 21:05:24 +0000 (0:00:00.182) 0:01:36.861 ******
changed: [instance]
TASK [libvirt_manager : Check image] *******************************************
Thursday 09 October 2025 21:05:45 +0000 (0:00:21.144) 0:01:58.006 ******
ok: [instance]
TASK [libvirt_manager : Assert image status] ***********************************
Thursday 09 October 2025 21:05:45 +0000 (0:00:00.217) 0:01:58.224 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [libvirt_manager : Ensure image access rights] ****************************
Thursday 09 October 2025 21:05:45 +0000 (0:00:00.040) 0:01:58.265 ******
changed: [instance]
TASK [libvirt_manager : Ensure directory exists] *******************************
Thursday 09 October 2025 21:05:46 +0000 (0:00:00.232) 0:01:58.497 ******
ok: [instance]
TASK [libvirt_manager : Check if base image exists] ****************************
Thursday 09 October 2025 21:05:46 +0000 (0:00:00.215) 0:01:58.712 ******
ok: [instance]
TASK [libvirt_manager : Download base image] ***********************************
Thursday 09 October 2025 21:05:46 +0000 (0:00:00.205) 0:01:58.918 ******
skipping: [instance]
TASK [libvirt_manager : Check image] *******************************************
Thursday 09 October 2025 21:05:46 +0000 (0:00:00.023) 0:01:58.941 ******
ok: [instance]
TASK [libvirt_manager : Assert image status] ***********************************
Thursday 09 October 2025 21:05:46 +0000 (0:00:00.223) 0:01:59.165 ******
ok: [instance] => changed=false
msg: All assertions passed
TASK [libvirt_manager : Ensure image access rights] ****************************
Thursday 09 October 2025 21:05:46 +0000 (0:00:00.051) 0:01:59.216 ******
ok: [instance]
TASK [libvirt_manager : Get ssh key state] *************************************
Thursday 09 October 2025 21:05:47 +0000 (0:00:00.237) 0:01:59.454 ******
ok: [instance]
TASK [libvirt_manager : Create temporary ssh keypair] **************************
Thursday 09 October 2025 21:05:47 +0000 (0:00:00.198) 0:01:59.652 ******
changed: [instance]
TASK [libvirt_manager : Slurp public key for later use] ************************
Thursday 09 October 2025 21:05:47 +0000 (0:00:00.450) 0:02:00.102 ******
ok: [instance]
TASK [libvirt_manager : Slurp private key for later use] ***********************
Thursday 09 October 2025 21:05:47 +0000 (0:00:00.204) 0:02:00.307 ******
ok: [instance]
TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
Thursday 09 October 2025 21:05:48 +0000 (0:00:00.195) 0:02:00.503 ******
changed: [instance]
TASK [libvirt_manager : Create fact holding network data for VMs] **************
Thursday 09 October 2025 21:05:48 +0000 (0:00:00.454) 0:02:00.958 ******
ok: [instance]
TASK [libvirt_manager : List existing networks] ********************************
Thursday 09 October 2025 21:05:48 +0000 (0:00:00.029) 0:02:00.987 ******
ok: [instance]
TASK [libvirt_manager : Gather pool fact] **************************************
Thursday 09 October 2025 21:05:48 +0000 (0:00:00.239) 0:02:01.227 ******
ok: [instance]
TASK [libvirt_manager : Create and run VMs] ************************************
Thursday 09 October 2025 21:05:49 +0000 (0:00:00.517) 0:02:01.744 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
TASK [libvirt_manager : Create VM image for compute-0] *************************
Thursday 09 October 2025 21:05:49 +0000 (0:00:00.124) 0:02:01.869 ******
changed: [instance]
TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
Thursday 09 October 2025 21:05:49 +0000 (0:00:00.276) 0:02:02.145 ******
changed: [instance]
TASK [libvirt_manager : Define VMs for type compute-0] *************************
Thursday 09 October 2025 21:05:50 +0000 (0:00:00.250) 0:02:02.395 ******
changed: [instance]
TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
Thursday 09 October 2025 21:05:50 +0000 (0:00:00.351) 0:02:02.747 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
Thursday 09 October 2025 21:05:50 +0000 (0:00:00.032) 0:02:02.779 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
TASK [libvirt_manager : Get virtual network information] ***********************
Thursday 09 October 2025 21:05:50 +0000 (0:00:00.097) 0:02:02.876 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Thursday 09 October 2025 21:05:50 +0000 (0:00:00.256) 0:02:03.133 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Thursday 09 October 2025 21:05:50 +0000 (0:00:00.052) 0:02:03.185 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Thursday 09 October 2025 21:05:51 +0000 (0:00:00.253) 0:02:03.438 ******
ok: [instance]
TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
Thursday 09 October 2025 21:05:51 +0000 (0:00:00.219) 0:02:03.658 ******
changed: [instance]
TASK [libvirt_manager : Get virtual network information] ***********************
Thursday 09 October 2025 21:05:51 +0000 (0:00:00.319) 0:02:03.978 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Thursday 09 October 2025 21:05:51 +0000 (0:00:00.253) 0:02:04.231 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Thursday 09 October 2025 21:05:51 +0000 (0:00:00.050) 0:02:04.282 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Thursday 09 October 2025 21:05:52 +0000 (0:00:00.259) 0:02:04.541 ******
ok: [instance]
TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
Thursday 09 October 2025 21:05:52 +0000 (0:00:00.215) 0:02:04.756 ******
changed: [instance]
TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
Thursday 09 October 2025 21:05:52 +0000 (0:00:00.308) 0:02:05.065 ******
skipping: [instance]
TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
Thursday 09 October 2025 21:05:52 +0000 (0:00:00.022) 0:02:05.088 ******
skipping: [instance]
TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
Thursday 09 October 2025 21:05:52 +0000 (0:00:00.031) 0:02:05.119 ******
skipping: [instance]
TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
Thursday 09 October 2025 21:05:52 +0000 (0:00:00.031) 0:02:05.151 ******
skipping: [instance]
TASK [libvirt_manager : Get VM UUID] *******************************************
Thursday 09 October 2025 21:05:52 +0000 (0:00:00.028) 0:02:05.179 ******
changed: [instance]
TASK [libvirt_manager : Inject UUID in dataset] ********************************
Thursday 09 October 2025 21:05:53 +0000 (0:00:00.234) 0:02:05.414 ******
ok: [instance]
TASK [libvirt_manager : Create cloud-init ISO] *********************************
Thursday 09 October 2025 21:05:53 +0000 (0:00:00.041) 0:02:05.455 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
Thursday 09 October 2025 21:05:53 +0000 (0:00:00.059) 0:02:05.515 ******
ok: [instance]
TASK [libvirt_manager : Define the default users for the vm] *******************
Thursday 09 October 2025 21:05:53 +0000 (0:00:00.212) 0:02:05.727 ******
ok: [instance]
TASK [libvirt_manager : Define the user data] **********************************
Thursday 09 October 2025 21:05:53 +0000 (0:00:00.067) 0:02:05.795 ******
ok: [instance]
TASK [libvirt_manager : Define the network config for all vms] *****************
Thursday 09 October 2025 21:05:53 +0000 (0:00:00.053) 0:02:05.848 ******
skipping: [instance]
TASK [libvirt_manager : Define the network config for each vm] *****************
Thursday 09 October 2025 21:05:53 +0000 (0:00:00.055) 0:02:05.904 ******
skipping: [instance]
TASK [Call the config_drive role] **********************************************
Thursday 09 October 2025 21:05:53 +0000 (0:00:00.051) 0:02:05.955 ******
TASK [config_drive : Ensure needed directories exist] **************************
Thursday 09 October 2025 21:05:53 +0000 (0:00:00.070) 0:02:06.026 ******
ok: [instance] => (item=artifacts)
ok: [instance] => (item=logs)
TASK [config_drive : Install required RPM packages] ****************************
Thursday 09 October 2025 21:05:54 +0000 (0:00:00.447) 0:02:06.474 ******
ok: [instance]
TASK [config_drive : Crate config drive instance directory] ********************
Thursday 09 October 2025 21:05:55 +0000 (0:00:01.215) 0:02:07.689 ******
changed: [instance]
TASK [config_drive : Generate meta-data] ***************************************
Thursday 09 October 2025 21:05:55 +0000 (0:00:00.251) 0:02:07.941 ******
changed: [instance]
TASK [config_drive : Generate user-data] ***************************************
Thursday 09 October 2025 21:05:56 +0000 (0:00:00.415) 0:02:08.357 ******
changed: [instance]
TASK [config_drive : Generate network-data] ************************************
Thursday 09 October 2025 21:05:56 +0000 (0:00:00.395) 0:02:08.753 ******
skipping: [instance]
TASK [config_drive : Check ISO availability] ***********************************
Thursday 09 October 2025 21:05:56 +0000 (0:00:00.046) 0:02:08.800 ******
ok: [instance]
TASK [config_drive : Assert we don't try to change an existing ISO] ************
Thursday 09 October 2025 21:05:56 +0000 (0:00:00.214) 0:02:09.014 ******
skipping: [instance]
TASK [config_drive : Generate nocloud iso image] *******************************
Thursday 09 October 2025 21:05:56 +0000 (0:00:00.048) 0:02:09.063 ******
Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
changed: [instance]
TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
Thursday 09 October 2025 21:05:56 +0000 (0:00:00.242) 0:02:09.306 ******
changed: [instance]
TASK [libvirt_manager : Attach additional devices if specified] ****************
Thursday 09 October 2025 21:05:57 +0000 (0:00:00.307) 0:02:09.613 ******
skipping: [instance]
TASK [libvirt_manager : Create VM image for controller-0] **********************
Thursday 09 October 2025 21:05:57 +0000 (0:00:00.054) 0:02:09.668 ******
changed: [instance]
TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
Thursday 09 October 2025 21:05:57 +0000 (0:00:00.274) 0:02:09.942 ******
changed: [instance]
TASK [libvirt_manager : Define VMs for type controller-0] **********************
Thursday 09 October 2025 21:05:57 +0000 (0:00:00.265) 0:02:10.208 ******
changed: [instance]
TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
Thursday 09 October 2025 21:05:58 +0000 (0:00:00.428) 0:02:10.637 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
Thursday 09 October 2025 21:05:58 +0000 (0:00:00.034) 0:02:10.672 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
TASK [libvirt_manager : Get virtual network information] ***********************
Thursday 09 October 2025 21:05:58 +0000 (0:00:00.047) 0:02:10.719 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Thursday 09 October 2025 21:05:58 +0000 (0:00:00.252) 0:02:10.971 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Thursday 09 October 2025 21:05:58 +0000 (0:00:00.051) 0:02:11.023 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Thursday 09 October 2025 21:05:58 +0000 (0:00:00.254) 0:02:11.277 ******
ok: [instance]
TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
Thursday 09 October 2025 21:05:59 +0000 (0:00:00.215) 0:02:11.493 ******
changed: [instance]
TASK [libvirt_manager : Get virtual network information] ***********************
Thursday 09 October 2025 21:05:59 +0000 (0:00:00.316) 0:02:11.809 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Thursday 09 October 2025 21:05:59 +0000 (0:00:00.259) 0:02:12.068 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Thursday 09 October 2025 21:05:59 +0000 (0:00:00.051) 0:02:12.119 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Thursday 09 October 2025 21:06:00 +0000 (0:00:00.253) 0:02:12.373 ******
ok: [instance]
TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
Thursday 09 October 2025 21:06:00 +0000 (0:00:00.230) 0:02:12.603 ******
changed: [instance]
TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
Thursday 09 October 2025 21:06:00 +0000 (0:00:00.307) 0:02:12.911 ******
skipping: [instance]
TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
Thursday 09 October 2025 21:06:00 +0000 (0:00:00.030) 0:02:12.942 ******
skipping: [instance]
TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
Thursday 09 October 2025 21:06:00 +0000 (0:00:00.033) 0:02:12.975 ******
skipping: [instance]
TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
Thursday 09 October 2025 21:06:00 +0000 (0:00:00.037) 0:02:13.013 ******
skipping: [instance]
TASK [libvirt_manager : Get VM UUID] *******************************************
Thursday 09 October 2025 21:06:00 +0000 (0:00:00.031) 0:02:13.044 ******
changed: [instance]
TASK [libvirt_manager : Inject UUID in dataset] ********************************
Thursday 09 October 2025 21:06:00 +0000 (0:00:00.241) 0:02:13.285 ******
ok: [instance]
TASK [libvirt_manager : Create cloud-init ISO] *********************************
Thursday 09 October 2025 21:06:00 +0000 (0:00:00.047) 0:02:13.333 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
Thursday 09 October 2025 21:06:01 +0000 (0:00:00.059) 0:02:13.392 ******
ok: [instance]
TASK [libvirt_manager : Define the default users for the vm] *******************
Thursday 09 October 2025 21:06:01 +0000 (0:00:00.221) 0:02:13.614 ******
ok: [instance]
TASK [libvirt_manager : Define the user data] **********************************
Thursday 09 October 2025 21:06:01 +0000 (0:00:00.071) 0:02:13.685 ******
ok: [instance]
TASK [libvirt_manager : Define the network config for all vms] *****************
Thursday 09 October 2025 21:06:01 +0000 (0:00:00.054) 0:02:13.740 ******
skipping: [instance]
TASK [libvirt_manager : Define the network config for each vm] *****************
Thursday 09 October 2025 21:06:01 +0000 (0:00:00.048) 0:02:13.788 ******
skipping: [instance]
TASK [Call the config_drive role] **********************************************
Thursday 09 October 2025 21:06:01 +0000 (0:00:00.046) 0:02:13.835 ******
TASK [config_drive : Ensure needed directories exist] **************************
Thursday 09 October 2025 21:06:01 +0000 (0:00:00.061) 0:02:13.896 ******
ok: [instance] => (item=artifacts)
ok: [instance] => (item=logs)
TASK [config_drive : Install required RPM packages] ****************************
Thursday 09 October 2025 21:06:01 +0000 (0:00:00.419) 0:02:14.316 ******
ok: [instance]
TASK [config_drive : Crate config drive instance directory] ********************
Thursday 09 October 2025 21:06:03 +0000 (0:00:01.216) 0:02:15.532 ******
changed: [instance]
TASK [config_drive : Generate meta-data] ***************************************
Thursday 09 October 2025 21:06:03 +0000 (0:00:00.227) 0:02:15.760 ******
changed: [instance]
TASK [config_drive : Generate user-data] ***************************************
Thursday 09 October 2025 21:06:03 +0000 (0:00:00.409) 0:02:16.170 ******
changed: [instance]
TASK [config_drive : Generate network-data] ************************************
Thursday 09 October 2025 21:06:04 +0000 (0:00:00.414) 0:02:16.584 ******
skipping: [instance]
TASK [config_drive : Check ISO availability] ***********************************
Thursday 09 October 2025 21:06:04 +0000 (0:00:00.051) 0:02:16.636 ******
ok: [instance]
TASK [config_drive : Assert we don't try to change an existing ISO] ************
Thursday 09 October 2025 21:06:04 +0000 (0:00:00.214) 0:02:16.850 ******
skipping: [instance]
TASK [config_drive : Generate nocloud iso image] *******************************
Thursday 09 October 2025 21:06:04 +0000 (0:00:00.047) 0:02:16.898 ******
Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
changed: [instance]
TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
Thursday 09 October 2025 21:06:04 +0000 (0:00:00.248) 0:02:17.146 ******
changed: [instance]
TASK [libvirt_manager : Attach additional devices if specified] ****************
Thursday 09 October 2025 21:06:05 +0000 (0:00:00.291) 0:02:17.438 ******
skipping: [instance]
TASK [libvirt_manager : Create VM image for crc-0] *****************************
Thursday 09 October 2025 21:06:05 +0000 (0:00:00.052) 0:02:17.490 ******
changed: [instance]
TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
Thursday 09 October 2025 21:06:05 +0000 (0:00:00.268) 0:02:17.758 ******
changed: [instance]
TASK [libvirt_manager : Define VMs for type crc-0] *****************************
Thursday 09 October 2025 21:06:05 +0000 (0:00:00.237) 0:02:17.996 ******
changed: [instance]
TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
Thursday 09 October 2025 21:06:06 +0000 (0:00:00.356) 0:02:18.352 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
Thursday 09 October 2025 21:06:06 +0000 (0:00:00.030) 0:02:18.383 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
TASK [libvirt_manager : Get virtual network information] ***********************
Thursday 09 October 2025 21:06:06 +0000 (0:00:00.044) 0:02:18.427 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Thursday 09 October 2025 21:06:06 +0000 (0:00:00.244) 0:02:18.672 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Thursday 09 October 2025 21:06:06 +0000 (0:00:00.044) 0:02:18.717 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Thursday 09 October 2025 21:06:06 +0000 (0:00:00.249) 0:02:18.966 ******
ok: [instance]
TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
Thursday 09 October 2025 21:06:06 +0000 (0:00:00.216) 0:02:19.182 ******
changed: [instance]
TASK [libvirt_manager : Get virtual network information] ***********************
Thursday 09 October 2025 21:06:07 +0000 (0:00:00.351) 0:02:19.533 ******
ok: [instance]
TASK [libvirt_manager : Create network to bridge mapping] **********************
Thursday 09 October 2025 21:06:07 +0000 (0:00:00.267) 0:02:19.801 ******
ok: [instance] => (item=cifmw-public)
ok: [instance] => (item=cifmw-osp_trunk)
TASK [libvirt_manager : Dump domain xml] ***************************************
Thursday 09 October 2025 21:06:07 +0000 (0:00:00.050) 0:02:19.851 ******
ok: [instance]
TASK [libvirt_manager : Extract networks from XML] *****************************
Thursday 09 October 2025 21:06:07 +0000 (0:00:00.245) 0:02:20.096 ******
ok: [instance]
TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
Thursday 09 October 2025 21:06:07 +0000 (0:00:00.216) 0:02:20.313 ******
changed: [instance]
TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
Thursday 09 October 2025 21:06:08 +0000 (0:00:00.311) 0:02:20.624 ******
skipping: [instance]
TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
Thursday 09 October 2025 21:06:08 +0000 (0:00:00.029) 0:02:20.654 ******
skipping: [instance]
TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
Thursday 09 October 2025 21:06:08 +0000 (0:00:00.034) 0:02:20.688 ******
skipping: [instance]
TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
Thursday 09 October 2025 21:06:08 +0000 (0:00:00.031) 0:02:20.720 ******
skipping: [instance]
TASK [libvirt_manager : Get VM UUID] *******************************************
Thursday 09 October 2025 21:06:08 +0000 (0:00:00.027) 0:02:20.748 ******
changed: [instance]
TASK [libvirt_manager : Inject UUID in dataset] ********************************
Thursday 09 October 2025 21:06:08 +0000 (0:00:00.224) 0:02:20.972 ******
ok: [instance]
TASK [libvirt_manager : Create cloud-init ISO] *********************************
Thursday 09 October 2025 21:06:08 +0000 (0:00:00.041) 0:02:21.014 ******
skipping: [instance]
TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
Thursday 09 October 2025 21:06:08 +0000 (0:00:00.035) 0:02:21.049 ******
skipping: [instance]
TASK [libvirt_manager : Attach additional devices if specified] ****************
Thursday 09 October 2025 21:06:08 +0000 (0:00:00.032) 0:02:21.082 ******
skipping: [instance]
TASK [libvirt_manager : Start (power-on) VMs] **********************************
Thursday 09 October 2025 21:06:08 +0000 (0:00:00.055) 0:02:21.137 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
Thursday 09 October 2025 21:06:08 +0000 (0:00:00.065) 0:02:21.203 ******
ok: [instance] => (item=crc)
TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
Thursday 09 October 2025 21:06:09 +0000 (0:00:00.254) 0:02:21.458 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
TASK [libvirt_manager : Start vm] **********************************************
Thursday 09 October 2025 21:06:11 +0000 (0:00:02.075) 0:02:23.533 ******
changed: [instance]
TASK [libvirt_manager : Start vm] **********************************************
Thursday 09 October 2025 21:06:12 +0000 (0:00:00.951) 0:02:24.485 ******
changed: [instance]
TASK [libvirt_manager : Start vm] **********************************************
Thursday 09 October 2025 21:06:13 +0000 (0:00:00.910) 0:02:25.396 ******
changed: [instance]
TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
Thursday 09 October 2025 21:06:13 +0000 (0:00:00.925) 0:02:26.322 ******
changed: [instance] => (item=compute-0.utility)
changed: [instance] => (item=controller-0.utility)
changed: [instance] => (item=crc-0.utility)
TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
Thursday 09 October 2025 21:06:14 +0000 (0:00:00.793) 0:02:27.115 ******
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left).
ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j429523261126.23994', 'results_file': '/home/zuul/.ansible_async/j429523261126.23994', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j139429523359.24011', 'results_file': '/home/zuul/.ansible_async/j139429523359.24011', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j181972631963.24027', 'results_file': '/home/zuul/.ansible_async/j181972631963.24027', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
TASK [libvirt_manager : Configure managed VMs] *********************************
Thursday 09 October 2025 21:06:34 +0000 (0:00:19.985) 0:02:47.101 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
TASK [Check if new ssh keypair exists] *****************************************
Thursday 09 October 2025 21:06:34 +0000 (0:00:00.136) 0:02:47.237 ******
skipping: [instance]
TASK [Push ssh jumper/configuration for compute-0] *****************************
Thursday 09 October 2025 21:06:34 +0000 (0:00:00.029) 0:02:47.266 ******
TASK [ssh_jumper : Create ssh-jumper entries] **********************************
Thursday 09 October 2025 21:06:34 +0000 (0:00:00.045) 0:02:47.311 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
Thursday 09 October 2025 21:06:35 +0000 (0:00:00.093) 0:02:47.405 ******
changed: [instance]
TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
Thursday 09 October 2025 21:06:35 +0000 (0:00:00.243) 0:02:47.648 ******
changed: [instance]
TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
Thursday 09 October 2025 21:06:35 +0000 (0:00:00.245) 0:02:47.894 ******
changed: [instance]
TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
Thursday 09 October 2025 21:06:35 +0000 (0:00:00.408) 0:02:48.303 ******
skipping: [instance]
TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
Thursday 09 October 2025 21:06:35 +0000 (0:00:00.037) 0:02:48.340 ******
skipping: [instance]
TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
Thursday 09 October 2025 21:06:36 +0000 (0:00:00.037) 0:02:48.378 ******
skipping: [instance]
TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
Thursday 09 October 2025 21:06:36 +0000 (0:00:00.056) 0:02:48.435 ******
skipping: [instance]
TASK [Check if new ssh keypair exists] *****************************************
Thursday 09 October 2025 21:06:36 +0000 (0:00:00.051) 0:02:48.486 ******
skipping: [instance]
TASK [Push ssh jumper/configuration for controller-0] **************************
Thursday 09 October 2025 21:06:36 +0000 (0:00:00.029) 0:02:48.516 ******
TASK [ssh_jumper : Create ssh-jumper entries] **********************************
Thursday 09 October 2025 21:06:36 +0000 (0:00:00.038) 0:02:48.555 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
Thursday 09 October 2025 21:06:36 +0000 (0:00:00.080) 0:02:48.635 ******
ok: [instance]
TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
Thursday 09 October 2025 21:06:36 +0000 (0:00:00.314) 0:02:48.949 ******
ok: [instance]
TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
Thursday 09 October 2025 21:06:36 +0000 (0:00:00.212) 0:02:49.162 ******
changed: [instance]
TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
Thursday 09 October 2025 21:06:37 +0000 (0:00:00.414) 0:02:49.576 ******
skipping: [instance]
TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
Thursday 09 October 2025 21:06:37 +0000 (0:00:00.034) 0:02:49.610 ******
skipping: [instance]
TASK [libvirt_manager : Inject private key on hosts controller-0] **************
Thursday 09 October 2025 21:06:37 +0000 (0:00:00.034) 0:02:49.644 ******
changed: [instance -> controller-0.instance]
TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
Thursday 09 October 2025 21:06:38 +0000 (0:00:01.585) 0:02:51.230 ******
changed: [instance -> controller-0.instance]
TASK [Check if new ssh keypair exists] *****************************************
Thursday 09 October 2025 21:06:40 +0000 (0:00:01.185) 0:02:52.415 ******
TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
Thursday 09 October 2025 21:06:40 +0000 (0:00:00.042) 0:02:52.458 ******
ok: [instance]
TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
Thursday 09 October 2025 21:06:40 +0000 (0:00:00.230) 0:02:52.689 ******
ok: [instance]
TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
Thursday 09 October 2025 21:06:40 +0000 (0:00:00.028) 0:02:52.718 ******
skipping: [instance]
TASK [Push ssh jumper/configuration for crc-0] *********************************
Thursday 09 October 2025 21:06:40 +0000 (0:00:00.041) 0:02:52.759 ******
TASK [ssh_jumper : Create ssh-jumper entries] **********************************
Thursday 09 October 2025 21:06:40 +0000 (0:00:00.053) 0:02:52.813 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
Thursday 09 October 2025 21:06:40 +0000 (0:00:00.094) 0:02:52.908 ******
ok: [instance]
TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
Thursday 09 October 2025 21:06:40 +0000 (0:00:00.238) 0:02:53.146 ******
ok: [instance]
TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
Thursday 09 October 2025 21:06:41 +0000 (0:00:00.240) 0:02:53.387 ******
changed: [instance]
TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
Thursday 09 October 2025 21:06:41 +0000 (0:00:00.398) 0:02:53.785 ******
changed: [instance]
TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
Thursday 09 October 2025 21:06:42 +0000 (0:00:00.795) 0:02:54.580 ******
skipping: [instance]
TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
Thursday 09 October 2025 21:06:42 +0000 (0:00:00.039) 0:02:54.620 ******
skipping: [instance]
TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
Thursday 09 October 2025 21:06:42 +0000 (0:00:00.056) 0:02:54.676 ******
skipping: [instance]
TASK [Create VBMC entity] ******************************************************
Thursday 09 October 2025 21:06:42 +0000 (0:00:00.050) 0:02:54.726 ******
skipping: [instance] => (item=compute-0)
skipping: [instance] => (item=controller-0)
skipping: [instance] => (item=crc-0)
skipping: [instance]
TASK [libvirt_manager : List running virtual machines.] ************************
Thursday 09 October 2025 21:06:42 +0000 (0:00:00.053) 0:02:54.780 ******
ok: [instance]
TASK [libvirt_manager : Dump UUIDs] ********************************************
Thursday 09 October 2025 21:06:42 +0000 (0:00:00.259) 0:02:55.040 ******
changed: [instance]
TASK [Ensure fresh vbmc listing] ***********************************************
Thursday 09 October 2025 21:06:43 +0000 (0:00:00.429) 0:02:55.469 ******
skipping: [instance]
TASK [libvirt_manager : Update vbmc related fact] ******************************
Thursday 09 October 2025 21:06:43 +0000 (0:00:00.040) 0:02:55.509 ******
skipping: [instance]
TASK [libvirt_manager : Dump vbmc known hosts] *********************************
Thursday 09 October 2025 21:06:43 +0000 (0:00:00.044) 0:02:55.553 ******
skipping: [instance]
TASK [libvirt_manager : Copy authorized_keys] **********************************
Thursday 09 October 2025 21:06:43 +0000 (0:00:00.040) 0:02:55.594 ******
changed: [instance]
TASK [libvirt_manager : Enable root access on CRC] *****************************
Thursday 09 October 2025 21:06:43 +0000 (0:00:00.699) 0:02:56.294 ******
changed: [instance]
TASK [reproducer : Get deployed VM group inventories] **************************
Thursday 09 October 2025 21:06:44 +0000 (0:00:00.704) 0:02:56.998 ******
skipping: [instance]
TASK [reproducer : Inject remote inventories onto main hypervisor] *************
Thursday 09 October 2025 21:06:44 +0000 (0:00:00.052) 0:02:57.051 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
TASK [reproducer : Gather inventories from instance] ***************************
Thursday 09 October 2025 21:06:44 +0000 (0:00:00.073) 0:02:57.124 ******
skipping: [instance]
TASK [reproducer : Gather inventories from compute-0] **************************
Thursday 09 October 2025 21:06:44 +0000 (0:00:00.054) 0:02:57.178 ******
skipping: [instance]
TASK [reproducer : Gather inventories from controller-0] ***********************
Thursday 09 October 2025 21:06:44 +0000 (0:00:00.047) 0:02:57.226 ******
skipping: [instance]
TASK [reproducer : Gather inventories from crc-0] ******************************
Thursday 09 October 2025 21:06:44 +0000 (0:00:00.044) 0:02:57.271 ******
skipping: [instance]
TASK [reproducer : Push generated inventory from hypervisor] *******************
Thursday 09 October 2025 21:06:44 +0000 (0:00:00.046) 0:02:57.317 ******
changed: [instance]
TASK [reproducer : Slurp devscripts private key] *******************************
Thursday 09 October 2025 21:06:45 +0000 (0:00:00.696) 0:02:58.014 ******
skipping: [instance]
TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
Thursday 09 October 2025 21:06:45 +0000 (0:00:00.043) 0:02:58.057 ******
skipping: [instance]
TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
Thursday 09 October 2025 21:06:45 +0000 (0:00:00.039) 0:02:58.097 ******
skipping: [instance]
TASK [openshift_login : Assert we have needed parameters] **********************
Thursday 09 October 2025 21:06:45 +0000 (0:00:00.043) 0:02:58.140 ******
skipping: [instance]
TASK [openshift_login : Stat kubeconfig] ***************************************
Thursday 09 October 2025 21:06:45 +0000 (0:00:00.043) 0:02:58.183 ******
skipping: [instance]
TASK [openshift_login : Stat kubeadmin] ****************************************
Thursday 09 October 2025 21:06:45 +0000 (0:00:00.039) 0:02:58.222 ******
skipping: [instance]
TASK [openshift_login : Assert files exist] ************************************
Thursday 09 October 2025 21:06:45 +0000 (0:00:00.036) 0:02:58.259 ******
skipping: [instance]
TASK [openshift_login : Gather the password of the deployed cluster.] **********
Thursday 09 October 2025 21:06:45 +0000 (0:00:00.035) 0:02:58.295 ******
skipping: [instance]
TASK [openshift_login : Gather the deployed OCP configuration.] ****************
Thursday 09 October 2025 21:06:45 +0000 (0:00:00.034) 0:02:58.329 ******
skipping: [instance]
TASK [openshift_login : Set the OpenShift platform access information.] ********
Thursday 09 October 2025 21:06:46 +0000 (0:00:00.038) 0:02:58.368 ******
skipping: [instance]
TASK [reproducer : Set fact for later wait on OCP cluster] *********************
Thursday 09 October 2025 21:06:46 +0000 (0:00:00.052) 0:02:58.420 ******
skipping: [instance]
TASK [reproducer : Configure Controller node] **********************************
Thursday 09 October 2025 21:06:46 +0000 (0:00:00.040) 0:02:58.461 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
TASK [reproducer : Set facts related to the reproducer] ************************
Thursday 09 October 2025 21:06:46 +0000 (0:00:00.228) 0:02:58.689 ******
ok: [instance]
TASK [reproducer : Ensure directories exist] ***********************************
Thursday 09 October 2025 21:06:46 +0000 (0:00:00.044) 0:02:58.734 ******
changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
TASK [reproducer : Tweak dnf configuration] ************************************
Thursday 09 October 2025 21:06:47 +0000 (0:00:01.581) 0:03:00.315 ******
skipping: [instance]
TASK [install_ca : Ensure target directory exists] *****************************
Thursday 09 October 2025 21:06:48 +0000 (0:00:00.029) 0:03:00.345 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [install_ca : Install internal CA from url] *******************************
Thursday 09 October 2025 21:06:48 +0000 (0:00:00.790) 0:03:01.135 ******
skipping: [instance]
TASK [install_ca : Install custom CA bundle from inline] ***********************
Thursday 09 October 2025 21:06:48 +0000 (0:00:00.043) 0:03:01.179 ******
skipping: [instance]
TASK [install_ca : Install custom CA bundle from file] *************************
Thursday 09 October 2025 21:06:48 +0000 (0:00:00.046) 0:03:01.225 ******
skipping: [instance]
TASK [install_ca : Update ca bundle] *******************************************
Thursday 09 October 2025 21:06:48 +0000 (0:00:00.041) 0:03:01.266 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Get rhos-release] *******************************************
Thursday 09 October 2025 21:06:50 +0000 (0:00:01.652) 0:03:02.919 ******
skipping: [instance]
TASK [reproducer : Install repos] **********************************************
Thursday 09 October 2025 21:06:50 +0000 (0:00:00.049) 0:03:02.968 ******
skipping: [instance]
TASK [reproducer : Run custom commands after rhos-release setup] ***************
Thursday 09 October 2025 21:06:50 +0000 (0:00:00.040) 0:03:03.009 ******
skipping: [instance]
TASK [reproducer : Create bundle for CRC] **************************************
Thursday 09 October 2025 21:06:50 +0000 (0:00:00.045) 0:03:03.054 ******
skipping: [instance]
TASK [reproducer : Install some tools] *****************************************
Thursday 09 October 2025 21:06:50 +0000 (0:00:00.047) 0:03:03.102 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Inject command aliases for faster debugging] ****************
Thursday 09 October 2025 21:06:52 +0000 (0:00:01.273) 0:03:04.376 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Build job inventory for hook usage] *************************
Thursday 09 October 2025 21:06:53 +0000 (0:00:01.191) 0:03:05.568 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Push the MAC mapping data] **********************************
Thursday 09 October 2025 21:06:53 +0000 (0:00:00.737) 0:03:06.305 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
Thursday 09 October 2025 21:06:55 +0000 (0:00:01.078) 0:03:07.383 ******
changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
skipping: [instance] => (item=compute-0)
skipping: [instance] => (item=controller-0)
skipping: [instance] => (item=crc-0)
TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
Thursday 09 October 2025 21:06:56 +0000 (0:00:01.221) 0:03:08.604 ******
changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
skipping: [instance] => (item=compute-0)
skipping: [instance] => (item=controller-0)
skipping: [instance] => (item=crc-0)
TASK [reproducer : Inject SSH configuration] ***********************************
Thursday 09 October 2025 21:06:57 +0000 (0:00:00.789) 0:03:09.394 ******
skipping: [instance] => (item=instance)
changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0)
changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0)
TASK [reproducer : Create kube directory] **************************************
Thursday 09 October 2025 21:06:58 +0000 (0:00:01.922) 0:03:11.317 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Inject kubeconfig content] **********************************
Thursday 09 October 2025 21:06:59 +0000 (0:00:00.610) 0:03:11.928 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Inject kubeadmin-password if exists] ************************
Thursday 09 October 2025 21:07:00 +0000 (0:00:01.012) 0:03:12.940 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Inject devscripts private key if set] ***********************
Thursday 09 October 2025 21:07:01 +0000 (0:00:01.105) 0:03:14.045 ******
skipping: [instance]
TASK [reproducer : Ensure /etc/ci/env is created] ******************************
Thursday 09 October 2025 21:07:01 +0000 (0:00:00.043) 0:03:14.088 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [manage_secrets : Ensure directory tree exist] ****************************
Thursday 09 October 2025 21:07:02 +0000 (0:00:00.672) 0:03:14.761 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [manage_secrets : Assert we get needed data] ******************************
Thursday 09 October 2025 21:07:03 +0000 (0:00:00.683) 0:03:15.445 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [manage_secrets : Push reproducer secrets] ********************************
Thursday 09 October 2025 21:07:03 +0000 (0:00:00.046) 0:03:15.491 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'})
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'})
TASK [manage_secrets : Debug _secret_dest] *************************************
Thursday 09 October 2025 21:07:03 +0000 (0:00:00.076) 0:03:15.567 ******
ok: [instance -> controller-0(controller-0.instance)] =>
_secret_dest: /home/zuul/ci-framework-data/secrets/default.txt
TASK [manage_secrets : Debug _secret_file] *************************************
Thursday 09 October 2025 21:07:03 +0000 (0:00:00.061) 0:03:15.629 ******
ok: [instance -> controller-0(controller-0.instance)] =>
_secret_file: ''
TASK [manage_secrets : Debug _secret_content] **********************************
Thursday 09 October 2025 21:07:03 +0000 (0:00:00.062) 0:03:15.691 ******
ok: [instance -> controller-0(controller-0.instance)] =>
_secret_content: my-default-location-place
TASK [manage_secrets : Ensure parameter is an absolute path] *******************
Thursday 09 October 2025 21:07:03 +0000 (0:00:00.058) 0:03:15.749 ******
skipping: [instance]
TASK [manage_secrets : Check if pull secret src file exists] *******************
Thursday 09 October 2025 21:07:03 +0000 (0:00:00.053) 0:03:15.803 ******
skipping: [instance]
TASK [manage_secrets : Copy file to location] **********************************
Thursday 09 October 2025 21:07:03 +0000 (0:00:00.053) 0:03:15.856 ******
skipping: [instance]
TASK [manage_secrets : Create file from content] *******************************
Thursday 09 October 2025 21:07:03 +0000 (0:00:00.054) 0:03:15.911 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [manage_secrets : Debug _secret_dest] *************************************
Thursday 09 October 2025 21:07:04 +0000 (0:00:01.111) 0:03:17.022 ******
ok: [instance -> controller-0(controller-0.instance)] =>
_secret_dest: /home/zuul/ipmi-things
TASK [manage_secrets : Debug _secret_file] *************************************
Thursday 09 October 2025 21:07:04 +0000 (0:00:00.061) 0:03:17.084 ******
ok: [instance -> controller-0(controller-0.instance)] =>
_secret_file: /tmp/ipmi-things
TASK [manage_secrets : Debug _secret_content] **********************************
Thursday 09 October 2025 21:07:04 +0000 (0:00:00.055) 0:03:17.140 ******
ok: [instance -> controller-0(controller-0.instance)] =>
_secret_content: ''
TASK [manage_secrets : Ensure parameter is an absolute path] *******************
Thursday 09 October 2025 21:07:04 +0000 (0:00:00.055) 0:03:17.195 ******
ok: [instance -> controller-0(controller-0.instance)] => changed=false
msg: All assertions passed
TASK [manage_secrets : Check if pull secret src file exists] *******************
Thursday 09 October 2025 21:07:04 +0000 (0:00:00.068) 0:03:17.264 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [manage_secrets : Copy file to location] **********************************
Thursday 09 October 2025 21:07:05 +0000 (0:00:00.646) 0:03:17.910 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [manage_secrets : Create file from content] *******************************
Thursday 09 October 2025 21:07:06 +0000 (0:00:01.083) 0:03:18.994 ******
skipping: [instance]
TASK [reproducer : Inject FQDN in /etc/hosts] **********************************
Thursday 09 October 2025 21:07:06 +0000 (0:00:00.065) 0:03:19.059 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Check if async file is still available] *********************
Thursday 09 October 2025 21:07:07 +0000 (0:00:00.657) 0:03:19.716 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Check package install status] *******************************
Thursday 09 October 2025 21:07:08 +0000 (0:00:00.711) 0:03:20.428 ******
FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (89 retries left).
FAILED - RETRYING: [instance -> controller-0]: Check package install status (88 retries left).
changed: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Create Sushy Emulator resource directory] ***************
Thursday 09 October 2025 21:08:21 +0000 (0:01:13.082) 0:04:33.511 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Install required packages] ******************************
Thursday 09 October 2025 21:08:21 +0000 (0:00:00.617) 0:04:34.128 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Get ingresses domain] ***********************************
Thursday 09 October 2025 21:08:24 +0000 (0:00:02.661) 0:04:36.790 ******
skipping: [instance]
TASK [sushy_emulator : Set sushy url for ocp installation] *********************
Thursday 09 October 2025 21:08:24 +0000 (0:00:00.054) 0:04:36.844 ******
skipping: [instance]
TASK [sushy_emulator : Create ssh key for Sushy Emulator] **********************
Thursday 09 October 2025 21:08:24 +0000 (0:00:00.061) 0:04:36.905 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Slurp private ssh key for later use] ********************
Thursday 09 October 2025 21:08:25 +0000 (0:00:00.704) 0:04:37.610 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Allow Sushy Emulator key] *******************************
Thursday 09 October 2025 21:08:25 +0000 (0:00:00.730) 0:04:38.340 ******
changed: [instance]
TASK [sushy_emulator : Run ssh-keyscan] ****************************************
Thursday 09 October 2025 21:08:26 +0000 (0:00:00.341) 0:04:38.682 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Write known hosts for later use] ************************
Thursday 09 October 2025 21:08:27 +0000 (0:00:00.871) 0:04:39.553 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
Thursday 09 October 2025 21:08:28 +0000 (0:00:01.168) 0:04:40.722 ******
skipping: [instance]
TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
Thursday 09 October 2025 21:08:28 +0000 (0:00:00.057) 0:04:40.780 ******
skipping: [instance]
TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
Thursday 09 October 2025 21:08:28 +0000 (0:00:00.054) 0:04:40.834 ******
skipping: [instance]
TASK [sushy_emulator : Generate list of filtered VMs] **************************
Thursday 09 October 2025 21:08:28 +0000 (0:00:00.052) 0:04:40.886 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Get Openstack instance UUIDs] ***************************
Thursday 09 October 2025 21:08:28 +0000 (0:00:00.082) 0:04:40.968 ******
skipping: [instance]
TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ********
Thursday 09 October 2025 21:08:28 +0000 (0:00:00.054) 0:04:41.024 ******
skipping: [instance]
TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] ***************
Thursday 09 October 2025 21:08:28 +0000 (0:00:00.057) 0:04:41.081 ******
skipping: [instance]
TASK [sushy_emulator : Generate htpasswd string] *******************************
Thursday 09 October 2025 21:08:28 +0000 (0:00:00.061) 0:04:41.142 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Write sushy emulator resource loop] *********************
Thursday 09 October 2025 21:08:29 +0000 (0:00:00.726) 0:04:41.869 ******
skipping: [instance] => (item=secret)
skipping: [instance] => (item=configmap)
skipping: [instance] => (item=pod)
skipping: [instance] => (item=service)
skipping: [instance] => (item=route)
skipping: [instance]
TASK [sushy_emulator : Write sushy emulator config] ****************************
Thursday 09 October 2025 21:08:29 +0000 (0:00:00.114) 0:04:41.983 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Write htpasswd string to file] **************************
Thursday 09 October 2025 21:08:30 +0000 (0:00:01.220) 0:04:43.203 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Create the sushy-emulator namespace] ********************
Thursday 09 October 2025 21:08:32 +0000 (0:00:01.156) 0:04:44.360 ******
skipping: [instance]
TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] ***
Thursday 09 October 2025 21:08:32 +0000 (0:00:00.058) 0:04:44.418 ******
skipping: [instance]
TASK [sushy_emulator : Apply Sushy Emulator resources] *************************
Thursday 09 October 2025 21:08:32 +0000 (0:00:00.054) 0:04:44.472 ******
skipping: [instance] => (item=secret)
skipping: [instance] => (item=configmap)
skipping: [instance] => (item=service)
skipping: [instance] => (item=route)
skipping: [instance]
TASK [sushy_emulator : Apply Sushy Emulator pod resource] **********************
Thursday 09 October 2025 21:08:32 +0000 (0:00:00.089) 0:04:44.561 ******
skipping: [instance]
TASK [podman : Ensure podman is installed] *************************************
Thursday 09 October 2025 21:08:32 +0000 (0:00:00.050) 0:04:44.612 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [podman : Enable loginctl linger for ansible_user_id] *********************
Thursday 09 October 2025 21:08:33 +0000 (0:00:01.701) 0:04:46.314 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [podman : Ensure subordinate UID entry exists for zuul] *******************
Thursday 09 October 2025 21:08:34 +0000 (0:00:00.833) 0:04:47.147 ******
skipping: [instance]
TASK [podman : Ensure subordinate GID entry exists for zuul] *******************
Thursday 09 October 2025 21:08:34 +0000 (0:00:00.049) 0:04:47.197 ******
skipping: [instance]
TASK [podman : Run podman system migrate if subuid/subgid files were changed] ***
Thursday 09 October 2025 21:08:34 +0000 (0:00:00.040) 0:04:47.238 ******
skipping: [instance]
TASK [sushy_emulator : Pull Sushy Emulator container image] ********************
Thursday 09 October 2025 21:08:34 +0000 (0:00:00.057) 0:04:47.295 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Create and start Sushy Emulator container] **************
Thursday 09 October 2025 21:08:45 +0000 (0:00:10.528) 0:04:57.824 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Ensure directories exist] ***********************************
Thursday 09 October 2025 21:08:46 +0000 (0:00:01.514) 0:04:59.338 ******
ok: [instance -> controller-0(controller-0.instance)] => (item=parameters)
ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
TASK [reproducer : Convert VBMC list into a dict for better usage] *************
Thursday 09 October 2025 21:08:48 +0000 (0:00:01.257) 0:05:00.595 ******
skipping: [instance]
TASK [reproducer : Check if baremetal-info.yml exists] *************************
Thursday 09 October 2025 21:08:48 +0000 (0:00:00.048) 0:05:00.644 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Get content of baremetal-info file] *************************
Thursday 09 October 2025 21:08:48 +0000 (0:00:00.671) 0:05:01.316 ******
skipping: [instance]
TASK [reproducer : Interpret remote file content as yaml] **********************
Thursday 09 October 2025 21:08:49 +0000 (0:00:00.048) 0:05:01.365 ******
skipping: [instance]
TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
Thursday 09 October 2025 21:08:49 +0000 (0:00:00.068) 0:05:01.433 ******
skipping: [instance]
TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
Thursday 09 October 2025 21:08:49 +0000 (0:00:00.054) 0:05:01.487 ******
skipping: [instance]
TASK [reproducer : Generate libvirt_manager_bm_info_data fact] *****************
Thursday 09 October 2025 21:08:49 +0000 (0:00:00.043) 0:05:01.531 ******
ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '2035c3c3-0793-45a0-9cc9-c0c39cf35f88'})
ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': 'e74368ae-a7f8-4805-a0a1-e563aff68bd3'})
ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': 'c06d5455-8e2a-454b-8092-d1494c796c38'})
TASK [reproducer : Output baremetal info file] *********************************
Thursday 09 October 2025 21:08:49 +0000 (0:00:00.150) 0:05:01.682 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Output ironic_nodes to file] ********************************
Thursday 09 October 2025 21:08:50 +0000 (0:00:01.075) 0:05:02.757 ******
skipping: [instance]
TASK [Verify connection to baremetal VMs via Sushy Emulator] *******************
Thursday 09 October 2025 21:08:50 +0000 (0:00:00.044) 0:05:02.801 ******
TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] ***
Thursday 09 October 2025 21:08:50 +0000 (0:00:00.157) 0:05:02.959 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
Thursday 09 October 2025 21:08:50 +0000 (0:00:00.052) 0:05:03.011 ******
skipping: [instance]
TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
Thursday 09 October 2025 21:08:50 +0000 (0:00:00.046) 0:05:03.057 ******
skipping: [instance]
TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] ***
Thursday 09 October 2025 21:08:50 +0000 (0:00:00.042) 0:05:03.100 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] ***
Thursday 09 October 2025 21:08:52 +0000 (0:00:01.585) 0:05:04.686 ******
ok: [instance -> controller-0(controller-0.instance)] => (item=2035c3c3-0793-45a0-9cc9-c0c39cf35f88)
ok: [instance -> controller-0(controller-0.instance)] => (item=e74368ae-a7f8-4805-a0a1-e563aff68bd3)
ok: [instance -> controller-0(controller-0.instance)] => (item=c06d5455-8e2a-454b-8092-d1494c796c38)
TASK [sushy_emulator : Verify baremetal VM power status] ***********************
Thursday 09 October 2025 21:08:57 +0000 (0:00:05.138) 0:05:09.825 ******
ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0)
ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0)
ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0)
TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] **********
Thursday 09 October 2025 21:08:57 +0000 (0:00:00.109) 0:05:09.934 ******
ok: [instance -> localhost]
TASK [reproducer : Sync local repositories to other hosts if present] **********
Thursday 09 October 2025 21:08:57 +0000 (0:00:00.236) 0:05:10.171 ******
changed: [instance -> localhost] => (item=controller-0)
TASK [reproducer : Check if common-requirements.txt exists on controller-0] ****
Thursday 09 October 2025 21:08:59 +0000 (0:00:01.865) 0:05:12.036 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Install ansible dependencies] *******************************
Thursday 09 October 2025 21:09:00 +0000 (0:00:00.739) 0:05:12.776 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] ***
Thursday 09 October 2025 21:09:01 +0000 (0:00:00.744) 0:05:13.521 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Create reproducer-variables.yml symlink to old location] ****
Thursday 09 October 2025 21:09:02 +0000 (0:00:01.191) 0:05:14.713 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Inject local environment parameters] ************************
Thursday 09 October 2025 21:09:03 +0000 (0:00:00.746) 0:05:15.460 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Create openshift-environment.yml symlink to old location] ***
Thursday 09 October 2025 21:09:04 +0000 (0:00:01.149) 0:05:16.609 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Get interfaces-info content] ********************************
Thursday 09 October 2025 21:09:04 +0000 (0:00:00.668) 0:05:17.278 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Wait for OCP nodes to be ready] *****************************
Thursday 09 October 2025 21:09:05 +0000 (0:00:00.674) 0:05:17.952 ******
ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
TASK [networking_mapper : Check for Networking Definition file existence] ******
Thursday 09 October 2025 21:09:07 +0000 (0:00:01.450) 0:05:19.403 ******
skipping: [instance]
TASK [networking_mapper : Load the Networking Definition from file] ************
Thursday 09 October 2025 21:09:07 +0000 (0:00:00.044) 0:05:19.447 ******
skipping: [instance]
TASK [networking_mapper : Check for interfaces info file existence] ************
Thursday 09 October 2025 21:09:07 +0000 (0:00:00.045) 0:05:19.493 ******
skipping: [instance]
TASK [networking_mapper : Load the interfaces info from file] ******************
Thursday 09 October 2025 21:09:07 +0000 (0:00:00.044) 0:05:19.537 ******
skipping: [instance]
TASK [networking_mapper : Ensure local fact is empty] **************************
Thursday 09 October 2025 21:09:07 +0000 (0:00:00.044) 0:05:19.582 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
Thursday 09 October 2025 21:09:07 +0000 (0:00:00.045) 0:05:19.627 ******
ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}})
ok: [instance -> controller-0(controller-0.instance)] => (item={})
TASK [networking_mapper : Gather facts if requested] ***************************
Thursday 09 October 2025 21:09:07 +0000 (0:00:00.114) 0:05:19.742 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance
TASK [networking_mapper : Gather the facts] ************************************
Thursday 09 October 2025 21:09:07 +0000 (0:00:00.059) 0:05:19.801 ******
ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0)
ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] ***
Thursday 09 October 2025 21:09:11 +0000 (0:00:03.700) 0:05:23.501 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
Thursday 09 October 2025 21:09:12 +0000 (0:00:01.109) 0:05:24.611 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [networking_mapper : Write the Networking Definition to file] *************
Thursday 09 October 2025 21:09:12 +0000 (0:00:00.500) 0:05:25.112 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [networking_mapper : Call the networking mapper] **************************
Thursday 09 October 2025 21:09:13 +0000 (0:00:00.981) 0:05:26.093 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [networking_mapper : Set networking mapper facts] *************************
Thursday 09 October 2025 21:09:13 +0000 (0:00:00.092) 0:05:26.186 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [networking_mapper : Write the Networking Environment Definition to file] ***
Thursday 09 October 2025 21:09:13 +0000 (0:00:00.061) 0:05:26.247 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Inject CRC ssh key] *****************************************
Thursday 09 October 2025 21:09:14 +0000 (0:00:01.066) 0:05:27.313 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Ensure we have all dependencies installed] ******************
Thursday 09 October 2025 21:09:15 +0000 (0:00:00.954) 0:05:28.268 ******
FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left).
changed: [instance -> controller-0(controller-0.instance)]
TASK [Configure ntp service] ***************************************************
Thursday 09 October 2025 21:09:22 +0000 (0:00:06.113) 0:05:34.381 ******
TASK [cifmw_ntp : Install chrony] **********************************************
Thursday 09 October 2025 21:09:22 +0000 (0:00:00.233) 0:05:34.615 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [cifmw_ntp : Configure original chrony.conf file] *************************
Thursday 09 October 2025 21:09:23 +0000 (0:00:01.026) 0:05:35.641 ******
ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True})
changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'})
TASK [cifmw_ntp : Render chrony extra config file] *****************************
Thursday 09 October 2025 21:09:24 +0000 (0:00:01.068) 0:05:36.709 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [cifmw_ntp : Enable chrony service] ***************************************
Thursday 09 October 2025 21:09:25 +0000 (0:00:01.024) 0:05:37.733 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Configure CRC node if available] ****************************
Thursday 09 October 2025 21:09:26 +0000 (0:00:00.732) 0:05:38.466 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance
TASK [reproducer : Get the networking-environment-definition from controller-0] ***
Thursday 09 October 2025 21:09:26 +0000 (0:00:00.143) 0:05:38.609 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Check which dnsmasq config we must edit] ********************
Thursday 09 October 2025 21:09:26 +0000 (0:00:00.539) 0:05:39.148 ******
ok: [instance -> crc-0(crc-0.instance)]
TASK [reproducer : Configure local DNS for CRC pod] ****************************
Thursday 09 October 2025 21:09:27 +0000 (0:00:00.523) 0:05:39.672 ******
changed: [instance -> crc-0(crc-0.instance)]
TASK [reproducer : Ensure dnsmasq listens on correct interfaces] ***************
Thursday 09 October 2025 21:09:28 +0000 (0:00:00.692) 0:05:40.365 ******
changed: [instance -> crc-0(crc-0.instance)]
TASK [Restart DNS in CRC VM] ***************************************************
Thursday 09 October 2025 21:09:28 +0000 (0:00:00.529) 0:05:40.894 ******
TASK [openshift_setup : Check which dnsmasq config we must edit] ***************
Thursday 09 October 2025 21:09:28 +0000 (0:00:00.053) 0:05:40.947 ******
ok: [instance -> crc-0(crc-0.instance)]
TASK [openshift_setup : Restart dnsmasq service if used] ***********************
Thursday 09 October 2025 21:09:29 +0000 (0:00:00.502) 0:05:41.450 ******
changed: [instance -> crc-0(crc-0.instance)]
TASK [openshift_setup : Stop dnsmasq] ******************************************
Thursday 09 October 2025 21:09:29 +0000 (0:00:00.788) 0:05:42.238 ******
skipping: [instance]
TASK [openshift_setup : Start dnsmasq] *****************************************
Thursday 09 October 2025 21:09:29 +0000 (0:00:00.043) 0:05:42.282 ******
skipping: [instance]
TASK [reproducer : Remove entry from /etc/hosts] *******************************
Thursday 09 October 2025 21:09:29 +0000 (0:00:00.042) 0:05:42.324 ******
changed: [instance]
TASK [Inject wildcard A/AAAA record for apps-crc.testing] **********************
Thursday 09 October 2025 21:09:30 +0000 (0:00:00.266) 0:05:42.590 ******
skipping: [instance] => (item=)
TASK [dnsmasq : Assert we have needed address data] ****************************
Thursday 09 October 2025 21:09:30 +0000 (0:00:00.078) 0:05:42.669 ******
ok: [instance]
TASK [dnsmasq : Assert each address element have needed data] ******************
Thursday 09 October 2025 21:09:30 +0000 (0:00:00.038) 0:05:42.707 ******
ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
TASK [dnsmasq : Add/Remove address] ********************************************
Thursday 09 October 2025 21:09:30 +0000 (0:00:00.078) 0:05:42.786 ******
changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************
Thursday 09 October 2025 21:09:30 +0000 (0:00:00.291) 0:05:43.077 ******
TASK [dnsmasq : Assert we have needed host record data] ************************
Thursday 09 October 2025 21:09:30 +0000 (0:00:00.051) 0:05:43.129 ******
ok: [instance]
TASK [dnsmasq : Assert each address element have needed data] ******************
Thursday 09 October 2025 21:09:30 +0000 (0:00:00.067) 0:05:43.196 ******
ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
TASK [dnsmasq : Add/Remove address] ********************************************
Thursday 09 October 2025 21:09:30 +0000 (0:00:00.062) 0:05:43.259 ******
changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
TASK [reproducer : Ensure "testing" domain is "local"] *************************
Thursday 09 October 2025 21:09:31 +0000 (0:00:00.280) 0:05:43.540 ******
changed: [instance]
TASK [reproducer : Flush handlers] *********************************************
Thursday 09 October 2025 21:09:31 +0000 (0:00:00.436) 0:05:43.976 ******
RUNNING HANDLER [cifmw_ntp : Restart chrony] ***********************************
Thursday 09 October 2025 21:09:31 +0000 (0:00:00.012) 0:05:43.989 ******
changed: [instance -> controller-0(controller-0.instance)]
RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
Thursday 09 October 2025 21:09:32 +0000 (0:00:00.822) 0:05:44.811 ******
changed: [instance]
TASK [reproducer : Configure EDPM based nodes ctlplane network] ****************
Thursday 09 October 2025 21:09:32 +0000 (0:00:00.408) 0:05:45.220 ******
skipping: [instance] => (item=controller-0)
skipping: [instance] => (item=crc-0)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0)
TASK [reproducer : Ensure we can ping controller-0 from ctlplane] **************
Thursday 09 October 2025 21:09:33 +0000 (0:00:00.180) 0:05:45.400 ******
changed: [instance -> compute-0(compute-0.instance)]
TASK [reproducer : Tweak dnf configuration] ************************************
Thursday 09 October 2025 21:09:34 +0000 (0:00:01.543) 0:05:46.944 ******
skipping: [instance]
TASK [install_ca : Ensure target directory exists] *****************************
Thursday 09 October 2025 21:09:34 +0000 (0:00:00.023) 0:05:46.967 ******
ok: [instance -> compute-0(compute-0.instance)]
TASK [install_ca : Install internal CA from url] *******************************
Thursday 09 October 2025 21:09:35 +0000 (0:00:00.554) 0:05:47.522 ******
skipping: [instance]
TASK [install_ca : Install custom CA bundle from inline] ***********************
Thursday 09 October 2025 21:09:35 +0000 (0:00:00.043) 0:05:47.566 ******
skipping: [instance]
TASK [install_ca : Install custom CA bundle from file] *************************
Thursday 09 October 2025 21:09:35 +0000 (0:00:00.043) 0:05:47.609 ******
skipping: [instance]
TASK [install_ca : Update ca bundle] *******************************************
Thursday 09 October 2025 21:09:35 +0000 (0:00:00.042) 0:05:47.651 ******
changed: [instance -> compute-0(compute-0.instance)]
TASK [reproducer : Get rhos-release and setup repos] ***************************
Thursday 09 October 2025 21:09:36 +0000 (0:00:01.453) 0:05:49.105 ******
skipping: [instance]
TASK [reproducer : Create repositories on computes] ****************************
Thursday 09 October 2025 21:09:36 +0000 (0:00:00.041) 0:05:49.146 ******
skipping: [instance]
TASK [reproducer : Apply VLAN ids to TAP type interfaces.] *********************
Thursday 09 October 2025 21:09:36 +0000 (0:00:00.022) 0:05:49.168 ******
skipping: [instance]
TASK [reproducer : Push local code] ********************************************
Thursday 09 October 2025 21:09:36 +0000 (0:00:00.034) 0:05:49.202 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance
TASK [reproducer : Check if repository directories already exist] **************
Thursday 09 October 2025 21:09:36 +0000 (0:00:00.102) 0:05:49.305 ******
skipping: [instance]
TASK [reproducer : Ensure we are not in the job_id branch] *********************
Thursday 09 October 2025 21:09:37 +0000 (0:00:00.045) 0:05:49.350 ******
skipping: [instance]
TASK [reproducer : Fetch zuul.items repositories] ******************************
Thursday 09 October 2025 21:09:37 +0000 (0:00:00.046) 0:05:49.397 ******
skipping: [instance]
TASK [reproducer : Fetch zuul.projects repositories for dependencies] **********
Thursday 09 October 2025 21:09:37 +0000 (0:00:00.053) 0:05:49.450 ******
skipping: [instance]
TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] ***
Thursday 09 October 2025 21:09:37 +0000 (0:00:00.049) 0:05:49.500 ******
skipping: [instance]
TASK [reproducer : Create target directories beforehand] ***********************
Thursday 09 October 2025 21:09:37 +0000 (0:00:00.046) 0:05:49.547 ******
ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators)
TASK [reproducer : Sync local repositories to ansible controller] **************
Thursday 09 October 2025 21:09:37 +0000 (0:00:00.529) 0:05:50.076 ******
ok: [instance -> localhost] => (item=ci-framework)
TASK [reproducer : Sync remote repositories] ***********************************
Thursday 09 October 2025 21:09:38 +0000 (0:00:00.631) 0:05:50.708 ******
skipping: [instance] => (item=ci-framework)
skipping: [instance]
TASK [reproducer : Ensure default repositories are present] ********************
Thursday 09 October 2025 21:09:38 +0000 (0:00:00.048) 0:05:50.756 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls)
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture)
TASK [reproducer : Check repository availability: ci-framework] ****************
Thursday 09 October 2025 21:09:38 +0000 (0:00:00.085) 0:05:50.842 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Clone repository if needed: ci-framework] *******************
Thursday 09 October 2025 21:09:39 +0000 (0:00:00.546) 0:05:51.389 ******
skipping: [instance]
TASK [reproducer : Check repository availability: install_yamls] ***************
Thursday 09 October 2025 21:09:39 +0000 (0:00:00.044) 0:05:51.433 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Clone repository if needed: install_yamls] ******************
Thursday 09 October 2025 21:09:39 +0000 (0:00:00.561) 0:05:51.994 ******
skipping: [instance]
TASK [reproducer : Check repository availability: architecture] ****************
Thursday 09 October 2025 21:09:39 +0000 (0:00:00.056) 0:05:52.050 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Clone repository if needed: architecture] *******************
Thursday 09 October 2025 21:09:40 +0000 (0:00:00.543) 0:05:52.593 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Install collections on controller-0] ************************
Thursday 09 October 2025 21:09:42 +0000 (0:00:02.451) 0:05:55.045 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Inject CI Framework motd] ***********************************
Thursday 09 October 2025 21:10:03 +0000 (0:00:20.344) 0:06:15.389 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Rotate some logs] *******************************************
Thursday 09 October 2025 21:10:04 +0000 (0:00:01.178) 0:06:16.567 ******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log)
TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] *********************
Thursday 09 October 2025 21:10:04 +0000 (0:00:00.107) 0:06:16.675 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [reproducer : Rotate log if present] **************************************
Thursday 09 October 2025 21:10:04 +0000 (0:00:00.508) 0:06:17.183 ******
skipping: [instance]
TASK [cifmw_setup : Set custom cifmw PATH reusable fact] ***********************
Thursday 09 October 2025 21:10:04 +0000 (0:00:00.046) 0:06:17.230 ******
skipping: [instance]
TASK [cifmw_setup : Get customized parameters] *********************************
Thursday 09 October 2025 21:10:04 +0000 (0:00:00.052) 0:06:17.282 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [install_ca : Ensure target directory exists] *****************************
Thursday 09 October 2025 21:10:05 +0000 (0:00:00.096) 0:06:17.379 ******
ok: [instance -> controller-0(controller-0.instance)]
TASK [install_ca : Install internal CA from url] *******************************
Thursday 09 October 2025 21:10:05 +0000 (0:00:00.534) 0:06:17.913 ******
skipping: [instance]
TASK [install_ca : Install custom CA bundle from inline] ***********************
Thursday 09 October 2025 21:10:05 +0000 (0:00:00.047) 0:06:17.960 ******
skipping: [instance]
TASK [install_ca : Install custom CA bundle from file] *************************
Thursday 09 October 2025 21:10:05 +0000 (0:00:00.051) 0:06:18.012 ******
skipping: [instance]
TASK [install_ca : Update ca bundle] *******************************************
Thursday 09 October 2025 21:10:05 +0000 (0:00:00.052) 0:06:18.065 ******
changed: [instance -> controller-0(controller-0.instance)]
TASK [repo_setup : Ensure directories are present] *****************************
Thursday 09 October 2025 21:10:07 +0000 (0:00:01.571) 0:06:19.637 ******
failed: [instance -> controller-0(controller-0.instance)] (item=None) => changed=false
censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result'
failed: [instance -> controller-0(controller-0.instance)] (item=None) => changed=false
censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result'
failed: [instance -> controller-0(controller-0.instance)] (item=None) => changed=false
censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result'
fatal: [instance -> controller-0]: FAILED! => changed=false
censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result'
TASK [Create dnsmasq dir] ******************************************************
Thursday 09 October 2025 21:10:08 +0000 (0:00:01.608) 0:06:21.245 ******
changed: [instance]
TASK [Get journalctl in a file] ************************************************
Thursday 09 October 2025 21:10:09 +0000 (0:00:00.220) 0:06:21.466 ******
changed: [instance]
TASK [Dump journalctl output] **************************************************
Thursday 09 October 2025 21:10:09 +0000 (0:00:00.268) 0:06:21.735 ******
changed: [instance]
TASK [Copy all dnsmasq config] *************************************************
Thursday 09 October 2025 21:10:09 +0000 (0:00:00.445) 0:06:22.180 ******
changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
TASK [Create log directory] ****************************************************
Thursday 09 October 2025 21:10:10 +0000 (0:00:00.550) 0:06:22.730 ******
changed: [instance]
TASK [Sync logs from controller-0] *********************************************
Thursday 09 October 2025 21:10:10 +0000 (0:00:00.223) 0:06:22.954 ******
changed: [instance]
PLAY RECAP *********************************************************************
instance : ok=489 changed=180 unreachable=0 failed=1 skipped=177 rescued=0 ignored=0
Thursday 09 October 2025 21:10:11 +0000 (0:00:00.952) 0:06:23.906 ******
===============================================================================
reproducer : Check package install status ------------------------------ 73.08s
libvirt_manager : Download base image ---------------------------------- 21.14s
reproducer : Install collections on controller-0 ----------------------- 20.34s
libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.99s
libvirt_manager : Install packages required for using KVM -------------- 11.64s
sushy_emulator : Pull Sushy Emulator container image ------------------- 10.53s
reproducer : Ensure we have all dependencies installed ------------------ 6.11s
ci_nmstate : Install required packages on localhost --------------------- 5.15s
sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.14s
dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.84s
networking_mapper : Gather the facts ------------------------------------ 3.70s
dnsmasq : Add/Remove address -------------------------------------------- 3.28s
sushy_emulator : Install required packages ------------------------------ 2.66s
reproducer : Ensure the required parameters are loaded ------------------ 2.63s
reproducer : Clone repository if needed: architecture ------------------- 2.45s
dnsmasq : Add DHCP entries ---------------------------------------------- 2.19s
libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.08s
reproducer : Inject SSH configuration ----------------------------------- 1.92s
discover_latest_image : Get latest image -------------------------------- 1.88s
reproducer : Sync local repositories to other hosts if present ---------- 1.87s