PLAY [Prepare] *****************************************************************
TASK [Gathering Facts] *********************************************************
Friday 27 February 2026 12:04:42 +0000 (0:00:00.024) 0:00:00.024 *******
ok: [instance]
TASK [test_deps : Gather facts if they don't exist] ****************************
Friday 27 February 2026 12:04:43 +0000 (0:00:01.057) 0:00:01.081 *******
skipping: [instance]
TASK [test_deps : Gather variables for each operating system] ******************
Friday 27 February 2026 12:04:43 +0000 (0:00:00.022) 0:00:01.104 *******
ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
TASK [test_deps : Detect mirrors file] *****************************************
Friday 27 February 2026 12:04:43 +0000 (0:00:00.051) 0:00:01.155 *******
ok: [instance]
TASK [test_deps : Disable ubi host subscription-manager integration] ***********
Friday 27 February 2026 12:04:44 +0000 (0:00:00.319) 0:00:01.474 *******
ok: [instance]
TASK [test_deps : Disable ubi 9 repos] *****************************************
Friday 27 February 2026 12:04:44 +0000 (0:00:00.384) 0:00:01.858 *******
ok: [instance] => (item=ubi-9-appstream)
ok: [instance] => (item=ubi-9-baseos)
ok: [instance] => (item=ubi-9-codeready-builder)
TASK [Deploy repo-setup] *******************************************************
Friday 27 February 2026 12:04:45 +0000 (0:00:00.681) 0:00:02.539 *******
TASK [repo_setup : Ensure directories are present] *****************************
Friday 27 February 2026 12:04:45 +0000 (0:00:00.086) 0:00:02.626 *******
changed: [instance] => (item=tmp)
changed: [instance] => (item=artifacts/repositories)
changed: [instance] => (item=venv/repo_setup)
TASK [repo_setup : Make sure git-core package is installed] ********************
Friday 27 February 2026 12:04:45 +0000 (0:00:00.553) 0:00:03.180 *******
ok: [instance]
TASK [repo_setup : Get repo-setup repository] **********************************
Friday 27 February 2026 12:04:46 +0000 (0:00:00.975) 0:00:04.155 *******
changed: [instance]
TASK [repo_setup : Initialize python venv and install requirements] ************
Friday 27 February 2026 12:04:47 +0000 (0:00:01.000) 0:00:05.156 *******
changed: [instance]
TASK [repo_setup : Install repo-setup package] *********************************
Friday 27 February 2026 12:04:56 +0000 (0:00:08.983) 0:00:14.139 *******
changed: [instance]
TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
Friday 27 February 2026 12:04:57 +0000 (0:00:00.871) 0:00:15.011 *******
skipping: [instance]
TASK [repo_setup : Run repo-setup] *********************************************
Friday 27 February 2026 12:04:57 +0000 (0:00:00.043) 0:00:15.054 *******
changed: [instance]
TASK [repo_setup : Get component repo] *****************************************
Friday 27 February 2026 12:04:58 +0000 (0:00:00.800) 0:00:15.855 *******
skipping: [instance]
TASK [repo_setup : Rename component repo] **************************************
Friday 27 February 2026 12:04:58 +0000 (0:00:00.039) 0:00:15.894 *******
skipping: [instance]
TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
Friday 27 February 2026 12:04:58 +0000 (0:00:00.035) 0:00:15.930 *******
skipping: [instance]
TASK [repo_setup : Run repo-setup-get-hash] ************************************
Friday 27 February 2026 12:04:58 +0000 (0:00:00.046) 0:00:15.976 *******
changed: [instance]
TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
Friday 27 February 2026 12:04:59 +0000 (0:00:00.560) 0:00:16.537 *******
changed: [instance]
TASK [repo_setup : Dump current-podified hash] *********************************
Friday 27 February 2026 12:04:59 +0000 (0:00:00.522) 0:00:17.060 *******
skipping: [instance]
TASK [repo_setup : Slurp current podified hash] ********************************
Friday 27 February 2026 12:04:59 +0000 (0:00:00.036) 0:00:17.096 *******
skipping: [instance]
TASK [repo_setup : Update the value of full_hash] ******************************
Friday 27 February 2026 12:04:59 +0000 (0:00:00.043) 0:00:17.140 *******
skipping: [instance]
TASK [repo_setup : Export hashes facts for further use] ************************
Friday 27 February 2026 12:04:59 +0000 (0:00:00.038) 0:00:17.179 *******
ok: [instance]
TASK [repo_setup : Create download directory] **********************************
Friday 27 February 2026 12:04:59 +0000 (0:00:00.041) 0:00:17.220 *******
skipping: [instance]
TASK [repo_setup : Print the URL to request] ***********************************
Friday 27 February 2026 12:04:59 +0000 (0:00:00.043) 0:00:17.264 *******
skipping: [instance]
TASK [Download the RPM] ********************************************************
Friday 27 February 2026 12:04:59 +0000 (0:00:00.041) 0:00:17.305 *******
skipping: [instance]
TASK [repo_setup : Install RHOS Release tool] **********************************
Friday 27 February 2026 12:05:00 +0000 (0:00:00.038) 0:00:17.343 *******
skipping: [instance]
TASK [repo_setup : Get rhos-release tool version] ******************************
Friday 27 February 2026 12:05:00 +0000 (0:00:00.035) 0:00:17.379 *******
skipping: [instance]
TASK [repo_setup : Print rhos-release tool version] ****************************
Friday 27 February 2026 12:05:00 +0000 (0:00:00.037) 0:00:17.416 *******
skipping: [instance]
TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
Friday 27 February 2026 12:05:00 +0000 (0:00:00.039) 0:00:17.456 *******
skipping: [instance]
TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
Friday 27 February 2026 12:05:00 +0000 (0:00:00.027) 0:00:17.484 *******
ok: [instance]
TASK [repo_setup : Use RDO proxy mirrors] **************************************
Friday 27 February 2026 12:05:00 +0000 (0:00:00.216) 0:00:17.700 *******
changed: [instance]
TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
Friday 27 February 2026 12:05:00 +0000 (0:00:00.270) 0:00:17.971 *******
changed: [instance]
TASK [repo_setup : Check for gating.repo file on content provider] *************
Friday 27 February 2026 12:05:00 +0000 (0:00:00.252) 0:00:18.223 *******
skipping: [instance]
TASK [repo_setup : Populate gating repo from content provider ip] **************
Friday 27 February 2026 12:05:00 +0000 (0:00:00.021) 0:00:18.245 *******
skipping: [instance]
TASK [repo_setup : Check for DLRN repo at the destination] *********************
Friday 27 February 2026 12:05:00 +0000 (0:00:00.021) 0:00:18.267 *******
skipping: [instance]
TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
Friday 27 February 2026 12:05:00 +0000 (0:00:00.025) 0:00:18.292 *******
skipping: [instance]
TASK [repo_setup : Check for DLRN component repo] ******************************
Friday 27 February 2026 12:05:00 +0000 (0:00:00.025) 0:00:18.317 *******
skipping: [instance]
TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
Friday 27 February 2026 12:05:01 +0000 (0:00:00.025) 0:00:18.343 *******
skipping: [instance]
TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
Friday 27 February 2026 12:05:01 +0000 (0:00:00.024) 0:00:18.368 *******
skipping: [instance]
TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
Friday 27 February 2026 12:05:01 +0000 (0:00:00.018) 0:00:18.386 *******
skipping: [instance]
TASK [repo_setup : Cleanup existing metadata] **********************************
Friday 27 February 2026 12:05:01 +0000 (0:00:00.035) 0:00:18.422 *******
skipping: [instance]
TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
Friday 27 February 2026 12:05:01 +0000 (0:00:00.019) 0:00:18.441 *******
skipping: [instance]
TASK [test_deps : Look for redhat-release rpm] *********************************
Friday 27 February 2026 12:05:01 +0000 (0:00:00.023) 0:00:18.465 *******
skipping: [instance]
TASK [test_deps : Remove redhat-release] ***************************************
Friday 27 February 2026 12:05:01 +0000 (0:00:00.038) 0:00:18.503 *******
skipping: [instance]
TASK [test_deps : Install centos-stream-release] *******************************
Friday 27 February 2026 12:05:01 +0000 (0:00:00.041) 0:00:18.544 *******
skipping: [instance]
TASK [test_deps : Install additional packages] *********************************
Friday 27 February 2026 12:05:01 +0000 (0:00:00.043) 0:00:18.588 *******
skipping: [instance]
TASK [test_deps : Install selinux python libs] *********************************
Friday 27 February 2026 12:05:01 +0000 (0:00:00.041) 0:00:18.630 *******
ok: [instance]
TASK [test_deps : Install python yaml libs] ************************************
Friday 27 February 2026 12:05:45 +0000 (0:00:44.077) 0:01:02.708 *******
ok: [instance]
TASK [test_deps : Install extra packages] **************************************
Friday 27 February 2026 12:05:46 +0000 (0:00:01.509) 0:01:04.217 *******
skipping: [instance]
TASK [ci_setup : Gather variables for each operating system] *******************
Friday 27 February 2026 12:05:46 +0000 (0:00:00.034) 0:01:04.252 *******
ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
TASK [ci_setup : List packages to install] *************************************
Friday 27 February 2026 12:05:46 +0000 (0:00:00.044) 0:01:04.296 *******
ok: [instance] =>
cifmw_ci_setup_packages:
- bash-completion
- ca-certificates
- git-core
- make
- tar
- tmux
- python3-pip
TASK [ci_setup : Install needed packages] **************************************
Friday 27 February 2026 12:05:46 +0000 (0:00:00.021) 0:01:04.317 *******
changed: [instance]
TASK [ci_setup : Gather version of openshift client] ***************************
Friday 27 February 2026 12:05:51 +0000 (0:00:04.047) 0:01:08.365 *******
ok: [instance]
TASK [ci_setup : Ensure openshift client install path is present] **************
Friday 27 February 2026 12:05:51 +0000 (0:00:00.284) 0:01:08.649 *******
changed: [instance]
TASK [ci_setup : Install openshift client] *************************************
Friday 27 February 2026 12:05:51 +0000 (0:00:00.230) 0:01:08.879 *******
changed: [instance]
TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
Friday 27 February 2026 12:05:56 +0000 (0:00:05.318) 0:01:14.198 *******
skipping: [instance]
TASK [ci_setup : Create completion file] ***************************************
Friday 27 February 2026 12:05:56 +0000 (0:00:00.040) 0:01:14.238 *******
changed: [instance]
TASK [ci_setup : Source completion from within .bashrc] ************************
Friday 27 February 2026 12:05:57 +0000 (0:00:00.316) 0:01:14.555 *******
changed: [instance]
TASK [ci_setup : Check rhsm status] ********************************************
Friday 27 February 2026 12:05:57 +0000 (0:00:00.315) 0:01:14.871 *******
skipping: [instance]
TASK [ci_setup : Gather the repos to be enabled] *******************************
Friday 27 February 2026 12:05:57 +0000 (0:00:00.017) 0:01:14.888 *******
skipping: [instance]
TASK [ci_setup : Enabling the required repositories.] **************************
Friday 27 February 2026 12:05:57 +0000 (0:00:00.017) 0:01:14.906 *******
skipping: [instance]
TASK [ci_setup : Get current /etc/redhat-release] ******************************
Friday 27 February 2026 12:05:57 +0000 (0:00:00.020) 0:01:14.926 *******
skipping: [instance]
TASK [ci_setup : Print current /etc/redhat-release] ****************************
Friday 27 February 2026 12:05:57 +0000 (0:00:00.022) 0:01:14.948 *******
skipping: [instance]
TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
Friday 27 February 2026 12:05:57 +0000 (0:00:00.023) 0:01:14.971 *******
skipping: [instance]
TASK [ci_setup : Manage directories] *******************************************
Friday 27 February 2026 12:05:57 +0000 (0:00:00.033) 0:01:15.004 *******
changed: [instance] => (item=/home/zuul/ci-framework-data/artifacts/manifests/openstack/cr)
ok: [instance] => (item=/home/zuul/ci-framework-data/logs)
ok: [instance] => (item=/home/zuul/ci-framework-data/tmp)
changed: [instance] => (item=/home/zuul/ci-framework-data/volumes)
ok: [instance] => (item=/home/zuul/ci-framework-data/artifacts/parameters)
TASK [Start CRC] ***************************************************************
Friday 27 February 2026 12:05:58 +0000 (0:00:01.176) 0:01:16.180 *******
TASK [cifmw_helpers : Ensure CRC is started] ***********************************
Friday 27 February 2026 12:05:58 +0000 (0:00:00.024) 0:01:16.204 *******
changed: [instance]
TASK [cifmw_helpers : Login to the OpenShift when certificate is expired] ******
Friday 27 February 2026 12:05:59 +0000 (0:00:00.621) 0:01:16.826 *******
skipping: [instance]
PLAY RECAP *********************************************************************
instance : ok=29 changed=16 unreachable=0 failed=0 skipped=38 rescued=0 ignored=0
Friday 27 February 2026 12:05:59 +0000 (0:00:00.037) 0:01:16.863 *******
===============================================================================
test_deps : Install selinux python libs -------------------------------- 44.08s
repo_setup : Initialize python venv and install requirements ------------ 8.98s
ci_setup : Install openshift client ------------------------------------- 5.32s
ci_setup : Install needed packages -------------------------------------- 4.05s
test_deps : Install python yaml libs ------------------------------------ 1.51s
ci_setup : Manage directories ------------------------------------------- 1.18s
Gathering Facts --------------------------------------------------------- 1.06s
repo_setup : Get repo-setup repository ---------------------------------- 1.00s
repo_setup : Make sure git-core package is installed -------------------- 0.98s
repo_setup : Install repo-setup package --------------------------------- 0.87s
repo_setup : Run repo-setup --------------------------------------------- 0.80s
test_deps : Disable ubi 9 repos ----------------------------------------- 0.68s
cifmw_helpers : Ensure CRC is started ----------------------------------- 0.62s
repo_setup : Run repo-setup-get-hash ------------------------------------ 0.56s
repo_setup : Ensure directories are present ----------------------------- 0.55s
repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.52s
test_deps : Disable ubi host subscription-manager integration ----------- 0.38s
test_deps : Detect mirrors file ----------------------------------------- 0.32s
ci_setup : Create completion file --------------------------------------- 0.32s
ci_setup : Source completion from within .bashrc ------------------------ 0.32s
PLAY [Converge] ****************************************************************
TASK [Gathering Facts] *********************************************************
Friday 27 February 2026 12:06:00 +0000 (0:00:00.020) 0:00:00.020 *******
ok: [instance]
TASK [os_must_gather : Ensure directories are present] *************************
Friday 27 February 2026 12:06:01 +0000 (0:00:00.893) 0:00:00.914 *******
changed: [instance]
TASK [os_must_gather : Construct project change list] **************************
Friday 27 February 2026 12:06:01 +0000 (0:00:00.332) 0:00:01.246 *******
skipping: [instance]
TASK [os_must_gather : Get git tag for image tagging] **************************
Friday 27 February 2026 12:06:01 +0000 (0:00:00.023) 0:00:01.270 *******
skipping: [instance]
TASK [os_must_gather : Debug git show-ref] *************************************
Friday 27 February 2026 12:06:01 +0000 (0:00:00.023) 0:00:01.293 *******
skipping: [instance]
TASK [os_must_gather : Build openstack-must-gather container] ******************
Friday 27 February 2026 12:06:01 +0000 (0:00:00.027) 0:00:01.320 *******
skipping: [instance]
TASK [os_must_gather : Push openstack-must-gather container] *******************
Friday 27 February 2026 12:06:01 +0000 (0:00:00.021) 0:00:01.342 *******
skipping: [instance]
TASK [os_must_gather : Set cifmw_os_must_gather_image to new image tag] ********
Friday 27 February 2026 12:06:01 +0000 (0:00:00.021) 0:00:01.363 *******
skipping: [instance]
TASK [os_must_gather : Check for oc command] ***********************************
Friday 27 February 2026 12:06:01 +0000 (0:00:00.029) 0:00:01.393 *******
Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_000_check_for_oc.log
changed: [instance]
TASK [os_must_gather : Check if kubeconfig exists] *****************************
Friday 27 February 2026 12:06:01 +0000 (0:00:00.099) 0:00:01.492 *******
ok: [instance]
TASK [os_must_gather : Run openstack-must-gather command] **********************
Friday 27 February 2026 12:06:02 +0000 (0:00:00.353) 0:00:01.845 *******
Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_001_run_openstack_must_gather.log
changed: [instance]
TASK [os_must_gather : Find existing os-must-gather directories] ***************
Friday 27 February 2026 12:08:54 +0000 (0:02:52.163) 0:02:54.009 *******
ok: [instance]
TASK [os_must_gather : Create a symlink to newest os-must-gather directory] ****
Friday 27 February 2026 12:08:54 +0000 (0:00:00.395) 0:02:54.405 *******
changed: [instance]
TASK [os_must_gather : Collect pod usage] **************************************
Friday 27 February 2026 12:08:54 +0000 (0:00:00.252) 0:02:54.657 *******
included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/os_must_gather/tasks/get_top.yml for instance
TASK [os_must_gather : Get all containers usage - sort by cpu] *****************
Friday 27 February 2026 12:08:54 +0000 (0:00:00.053) 0:02:54.711 *******
fatal: [instance]: FAILED! => changed=true
cmd: |-
oc adm top pods --all-namespaces --sort-by=cpu --containers > /home/zuul/ci-framework-data/logs/openstack-must-gather/latest/all-containers-cpu-top.log
delta: '0:00:00.150567'
end: '2026-02-27 12:08:55.371084'
msg: non-zero return code
rc: 1
start: '2026-02-27 12:08:55.220517'
stderr: 'error: Metrics API not available'
stderr_lines: <omitted>
stdout: ''
stdout_lines: <omitted>
...ignoring
TASK [os_must_gather : Print message when metrics are not available] ***********
Friday 27 February 2026 12:08:55 +0000 (0:00:00.526) 0:02:55.237 *******
skipping: [instance]
TASK [os_must_gather : Get all containers usage - sort by memory] **************
Friday 27 February 2026 12:08:55 +0000 (0:00:00.029) 0:02:55.267 *******
skipping: [instance]
TASK [os_must_gather : Find all namespaces directories] ************************
Friday 27 February 2026 12:08:55 +0000 (0:00:00.027) 0:02:55.294 *******
skipping: [instance]
TASK [os_must_gather : Get resource usage by pods per namespace] ***************
Friday 27 February 2026 12:08:55 +0000 (0:00:00.028) 0:02:55.323 *******
skipping: [instance]
TASK [os_must_gather : Get node resource usage] ********************************
Friday 27 February 2026 12:08:55 +0000 (0:00:00.028) 0:02:55.351 *******
skipping: [instance]
PLAY RECAP *********************************************************************
instance : ok=9 changed=5 unreachable=0 failed=0 skipped=11 rescued=0 ignored=1
Friday 27 February 2026 12:08:55 +0000 (0:00:00.057) 0:02:55.409 *******
===============================================================================
os_must_gather : Run openstack-must-gather command -------------------- 172.16s
Gathering Facts --------------------------------------------------------- 0.89s
os_must_gather : Get all containers usage - sort by cpu ----------------- 0.53s
os_must_gather : Find existing os-must-gather directories --------------- 0.40s
os_must_gather : Check if kubeconfig exists ----------------------------- 0.35s
os_must_gather : Ensure directories are present ------------------------- 0.33s
os_must_gather : Create a symlink to newest os-must-gather directory ---- 0.25s
os_must_gather : Check for oc command ----------------------------------- 0.10s
os_must_gather : Get node resource usage -------------------------------- 0.06s
os_must_gather : Collect pod usage -------------------------------------- 0.05s
os_must_gather : Set cifmw_os_must_gather_image to new image tag -------- 0.03s
os_must_gather : Print message when metrics are not available ----------- 0.03s
os_must_gather : Find all namespaces directories ------------------------ 0.03s
os_must_gather : Get resource usage by pods per namespace --------------- 0.03s
os_must_gather : Debug git show-ref ------------------------------------- 0.03s
os_must_gather : Get all containers usage - sort by memory -------------- 0.03s
os_must_gather : Get git tag for image tagging -------------------------- 0.02s
os_must_gather : Construct project change list -------------------------- 0.02s
os_must_gather : Build openstack-must-gather container ------------------ 0.02s
os_must_gather : Push openstack-must-gather container ------------------- 0.02s