PLAY [Prepare] ***************************************************************** TASK [Gathering Facts] ********************************************************* Friday 27 February 2026 12:04:42 +0000 (0:00:00.024) 0:00:00.024 ******* ok: [instance] TASK [test_deps : Gather facts if they don't exist] **************************** Friday 27 February 2026 12:04:43 +0000 (0:00:01.057) 0:00:01.081 ******* skipping: [instance] TASK [test_deps : Gather variables for each operating system] ****************** Friday 27 February 2026 12:04:43 +0000 (0:00:00.022) 0:00:01.104 ******* ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) TASK [test_deps : Detect mirrors file] ***************************************** Friday 27 February 2026 12:04:43 +0000 (0:00:00.051) 0:00:01.155 ******* ok: [instance] TASK [test_deps : Disable ubi host subscription-manager integration] *********** Friday 27 February 2026 12:04:44 +0000 (0:00:00.319) 0:00:01.474 ******* ok: [instance] TASK [test_deps : Disable ubi 9 repos] ***************************************** Friday 27 February 2026 12:04:44 +0000 (0:00:00.384) 0:00:01.858 ******* ok: [instance] => (item=ubi-9-appstream) ok: [instance] => (item=ubi-9-baseos) ok: [instance] => (item=ubi-9-codeready-builder) TASK [Deploy repo-setup] ******************************************************* Friday 27 February 2026 12:04:45 +0000 (0:00:00.681) 0:00:02.539 ******* TASK [repo_setup : Ensure directories are present] ***************************** Friday 27 February 2026 12:04:45 +0000 (0:00:00.086) 0:00:02.626 ******* changed: [instance] => (item=tmp) changed: [instance] => (item=artifacts/repositories) changed: [instance] => (item=venv/repo_setup) TASK [repo_setup : Make sure git-core package is installed] ******************** Friday 27 February 2026 12:04:45 +0000 (0:00:00.553) 0:00:03.180 ******* ok: [instance] TASK [repo_setup : Get repo-setup repository] ********************************** Friday 27 February 2026 12:04:46 +0000 (0:00:00.975) 0:00:04.155 ******* changed: [instance] TASK [repo_setup : Initialize python venv and install requirements] ************ Friday 27 February 2026 12:04:47 +0000 (0:00:01.000) 0:00:05.156 ******* changed: [instance] TASK [repo_setup : Install repo-setup package] ********************************* Friday 27 February 2026 12:04:56 +0000 (0:00:08.983) 0:00:14.139 ******* changed: [instance] TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** Friday 27 February 2026 12:04:57 +0000 (0:00:00.871) 0:00:15.011 ******* skipping: [instance] TASK [repo_setup : Run repo-setup] ********************************************* Friday 27 February 2026 12:04:57 +0000 (0:00:00.043) 0:00:15.054 ******* changed: [instance] TASK [repo_setup : Get component repo] ***************************************** Friday 27 February 2026 12:04:58 +0000 (0:00:00.800) 0:00:15.855 ******* skipping: [instance] TASK [repo_setup : Rename component repo] ************************************** Friday 27 February 2026 12:04:58 +0000 (0:00:00.039) 0:00:15.894 ******* skipping: [instance] TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* Friday 27 February 2026 12:04:58 +0000 (0:00:00.035) 0:00:15.930 ******* skipping: [instance] TASK [repo_setup : Run repo-setup-get-hash] ************************************ Friday 27 February 2026 12:04:58 +0000 (0:00:00.046) 0:00:15.976 ******* changed: [instance] TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* Friday 27 February 2026 12:04:59 +0000 (0:00:00.560) 0:00:16.537 ******* changed: [instance] TASK [repo_setup : Dump current-podified hash] ********************************* Friday 27 February 2026 12:04:59 +0000 (0:00:00.522) 0:00:17.060 ******* skipping: [instance] TASK [repo_setup : Slurp current podified hash] ******************************** Friday 27 February 2026 12:04:59 +0000 (0:00:00.036) 0:00:17.096 ******* skipping: [instance] TASK [repo_setup : Update the value of full_hash] ****************************** Friday 27 February 2026 12:04:59 +0000 (0:00:00.043) 0:00:17.140 ******* skipping: [instance] TASK [repo_setup : Export hashes facts for further use] ************************ Friday 27 February 2026 12:04:59 +0000 (0:00:00.038) 0:00:17.179 ******* ok: [instance] TASK [repo_setup : Create download directory] ********************************** Friday 27 February 2026 12:04:59 +0000 (0:00:00.041) 0:00:17.220 ******* skipping: [instance] TASK [repo_setup : Print the URL to request] *********************************** Friday 27 February 2026 12:04:59 +0000 (0:00:00.043) 0:00:17.264 ******* skipping: [instance] TASK [Download the RPM] ******************************************************** Friday 27 February 2026 12:04:59 +0000 (0:00:00.041) 0:00:17.305 ******* skipping: [instance] TASK [repo_setup : Install RHOS Release tool] ********************************** Friday 27 February 2026 12:05:00 +0000 (0:00:00.038) 0:00:17.343 ******* skipping: [instance] TASK [repo_setup : Get rhos-release tool version] ****************************** Friday 27 February 2026 12:05:00 +0000 (0:00:00.035) 0:00:17.379 ******* skipping: [instance] TASK [repo_setup : Print rhos-release tool version] **************************** Friday 27 February 2026 12:05:00 +0000 (0:00:00.037) 0:00:17.416 ******* skipping: [instance] TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** Friday 27 February 2026 12:05:00 +0000 (0:00:00.039) 0:00:17.456 ******* skipping: [instance] TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** Friday 27 February 2026 12:05:00 +0000 (0:00:00.027) 0:00:17.484 ******* ok: [instance] TASK [repo_setup : Use RDO proxy mirrors] ************************************** Friday 27 February 2026 12:05:00 +0000 (0:00:00.216) 0:00:17.700 ******* changed: [instance] TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** Friday 27 February 2026 12:05:00 +0000 (0:00:00.270) 0:00:17.971 ******* changed: [instance] TASK [repo_setup : Check for gating.repo file on content provider] ************* Friday 27 February 2026 12:05:00 +0000 (0:00:00.252) 0:00:18.223 ******* skipping: [instance] TASK [repo_setup : Populate gating repo from content provider ip] ************** Friday 27 February 2026 12:05:00 +0000 (0:00:00.021) 0:00:18.245 ******* skipping: [instance] TASK [repo_setup : Check for DLRN repo at the destination] ********************* Friday 27 February 2026 12:05:00 +0000 (0:00:00.021) 0:00:18.267 ******* skipping: [instance] TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** Friday 27 February 2026 12:05:00 +0000 (0:00:00.025) 0:00:18.292 ******* skipping: [instance] TASK [repo_setup : Check for DLRN component repo] ****************************** Friday 27 February 2026 12:05:00 +0000 (0:00:00.025) 0:00:18.317 ******* skipping: [instance] TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** Friday 27 February 2026 12:05:01 +0000 (0:00:00.025) 0:00:18.343 ******* skipping: [instance] TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** Friday 27 February 2026 12:05:01 +0000 (0:00:00.024) 0:00:18.368 ******* skipping: [instance] TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** Friday 27 February 2026 12:05:01 +0000 (0:00:00.018) 0:00:18.386 ******* skipping: [instance] TASK [repo_setup : Cleanup existing metadata] ********************************** Friday 27 February 2026 12:05:01 +0000 (0:00:00.035) 0:00:18.422 ******* skipping: [instance] TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* Friday 27 February 2026 12:05:01 +0000 (0:00:00.019) 0:00:18.441 ******* skipping: [instance] TASK [test_deps : Look for redhat-release rpm] ********************************* Friday 27 February 2026 12:05:01 +0000 (0:00:00.023) 0:00:18.465 ******* skipping: [instance] TASK [test_deps : Remove redhat-release] *************************************** Friday 27 February 2026 12:05:01 +0000 (0:00:00.038) 0:00:18.503 ******* skipping: [instance] TASK [test_deps : Install centos-stream-release] ******************************* Friday 27 February 2026 12:05:01 +0000 (0:00:00.041) 0:00:18.544 ******* skipping: [instance] TASK [test_deps : Install additional packages] ********************************* Friday 27 February 2026 12:05:01 +0000 (0:00:00.043) 0:00:18.588 ******* skipping: [instance] TASK [test_deps : Install selinux python libs] ********************************* Friday 27 February 2026 12:05:01 +0000 (0:00:00.041) 0:00:18.630 ******* ok: [instance] TASK [test_deps : Install python yaml libs] ************************************ Friday 27 February 2026 12:05:45 +0000 (0:00:44.077) 0:01:02.708 ******* ok: [instance] TASK [test_deps : Install extra packages] ************************************** Friday 27 February 2026 12:05:46 +0000 (0:00:01.509) 0:01:04.217 ******* skipping: [instance] TASK [ci_setup : Gather variables for each operating system] ******************* Friday 27 February 2026 12:05:46 +0000 (0:00:00.034) 0:01:04.252 ******* ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) TASK [ci_setup : List packages to install] ************************************* Friday 27 February 2026 12:05:46 +0000 (0:00:00.044) 0:01:04.296 ******* ok: [instance] => cifmw_ci_setup_packages: - bash-completion - ca-certificates - git-core - make - tar - tmux - python3-pip TASK [ci_setup : Install needed packages] ************************************** Friday 27 February 2026 12:05:46 +0000 (0:00:00.021) 0:01:04.317 ******* changed: [instance] TASK [ci_setup : Gather version of openshift client] *************************** Friday 27 February 2026 12:05:51 +0000 (0:00:04.047) 0:01:08.365 ******* ok: [instance] TASK [ci_setup : Ensure openshift client install path is present] ************** Friday 27 February 2026 12:05:51 +0000 (0:00:00.284) 0:01:08.649 ******* changed: [instance] TASK [ci_setup : Install openshift client] ************************************* Friday 27 February 2026 12:05:51 +0000 (0:00:00.230) 0:01:08.879 ******* changed: [instance] TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** Friday 27 February 2026 12:05:56 +0000 (0:00:05.318) 0:01:14.198 ******* skipping: [instance] TASK [ci_setup : Create completion file] *************************************** Friday 27 February 2026 12:05:56 +0000 (0:00:00.040) 0:01:14.238 ******* changed: [instance] TASK [ci_setup : Source completion from within .bashrc] ************************ Friday 27 February 2026 12:05:57 +0000 (0:00:00.316) 0:01:14.555 ******* changed: [instance] TASK [ci_setup : Check rhsm status] ******************************************** Friday 27 February 2026 12:05:57 +0000 (0:00:00.315) 0:01:14.871 ******* skipping: [instance] TASK [ci_setup : Gather the repos to be enabled] ******************************* Friday 27 February 2026 12:05:57 +0000 (0:00:00.017) 0:01:14.888 ******* skipping: [instance] TASK [ci_setup : Enabling the required repositories.] ************************** Friday 27 February 2026 12:05:57 +0000 (0:00:00.017) 0:01:14.906 ******* skipping: [instance] TASK [ci_setup : Get current /etc/redhat-release] ****************************** Friday 27 February 2026 12:05:57 +0000 (0:00:00.020) 0:01:14.926 ******* skipping: [instance] TASK [ci_setup : Print current /etc/redhat-release] **************************** Friday 27 February 2026 12:05:57 +0000 (0:00:00.022) 0:01:14.948 ******* skipping: [instance] TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* Friday 27 February 2026 12:05:57 +0000 (0:00:00.023) 0:01:14.971 ******* skipping: [instance] TASK [ci_setup : Manage directories] ******************************************* Friday 27 February 2026 12:05:57 +0000 (0:00:00.033) 0:01:15.004 ******* changed: [instance] => (item=/home/zuul/ci-framework-data/artifacts/manifests/openstack/cr) ok: [instance] => (item=/home/zuul/ci-framework-data/logs) ok: [instance] => (item=/home/zuul/ci-framework-data/tmp) changed: [instance] => (item=/home/zuul/ci-framework-data/volumes) ok: [instance] => (item=/home/zuul/ci-framework-data/artifacts/parameters) TASK [Start CRC] *************************************************************** Friday 27 February 2026 12:05:58 +0000 (0:00:01.176) 0:01:16.180 ******* TASK [cifmw_helpers : Ensure CRC is started] *********************************** Friday 27 February 2026 12:05:58 +0000 (0:00:00.024) 0:01:16.204 ******* changed: [instance] TASK [cifmw_helpers : Login to the OpenShift when certificate is expired] ****** Friday 27 February 2026 12:05:59 +0000 (0:00:00.621) 0:01:16.826 ******* skipping: [instance] PLAY RECAP ********************************************************************* instance : ok=29 changed=16 unreachable=0 failed=0 skipped=38 rescued=0 ignored=0 Friday 27 February 2026 12:05:59 +0000 (0:00:00.037) 0:01:16.863 ******* =============================================================================== test_deps : Install selinux python libs -------------------------------- 44.08s repo_setup : Initialize python venv and install requirements ------------ 8.98s ci_setup : Install openshift client ------------------------------------- 5.32s ci_setup : Install needed packages -------------------------------------- 4.05s test_deps : Install python yaml libs ------------------------------------ 1.51s ci_setup : Manage directories ------------------------------------------- 1.18s Gathering Facts --------------------------------------------------------- 1.06s repo_setup : Get repo-setup repository ---------------------------------- 1.00s repo_setup : Make sure git-core package is installed -------------------- 0.98s repo_setup : Install repo-setup package --------------------------------- 0.87s repo_setup : Run repo-setup --------------------------------------------- 0.80s test_deps : Disable ubi 9 repos ----------------------------------------- 0.68s cifmw_helpers : Ensure CRC is started ----------------------------------- 0.62s repo_setup : Run repo-setup-get-hash ------------------------------------ 0.56s repo_setup : Ensure directories are present ----------------------------- 0.55s repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.52s test_deps : Disable ubi host subscription-manager integration ----------- 0.38s test_deps : Detect mirrors file ----------------------------------------- 0.32s ci_setup : Create completion file --------------------------------------- 0.32s ci_setup : Source completion from within .bashrc ------------------------ 0.32s PLAY [Converge] **************************************************************** TASK [Gathering Facts] ********************************************************* Friday 27 February 2026 12:06:00 +0000 (0:00:00.020) 0:00:00.020 ******* ok: [instance] TASK [os_must_gather : Ensure directories are present] ************************* Friday 27 February 2026 12:06:01 +0000 (0:00:00.893) 0:00:00.914 ******* changed: [instance] TASK [os_must_gather : Construct project change list] ************************** Friday 27 February 2026 12:06:01 +0000 (0:00:00.332) 0:00:01.246 ******* skipping: [instance] TASK [os_must_gather : Get git tag for image tagging] ************************** Friday 27 February 2026 12:06:01 +0000 (0:00:00.023) 0:00:01.270 ******* skipping: [instance] TASK [os_must_gather : Debug git show-ref] ************************************* Friday 27 February 2026 12:06:01 +0000 (0:00:00.023) 0:00:01.293 ******* skipping: [instance] TASK [os_must_gather : Build openstack-must-gather container] ****************** Friday 27 February 2026 12:06:01 +0000 (0:00:00.027) 0:00:01.320 ******* skipping: [instance] TASK [os_must_gather : Push openstack-must-gather container] ******************* Friday 27 February 2026 12:06:01 +0000 (0:00:00.021) 0:00:01.342 ******* skipping: [instance] TASK [os_must_gather : Set cifmw_os_must_gather_image to new image tag] ******** Friday 27 February 2026 12:06:01 +0000 (0:00:00.021) 0:00:01.363 ******* skipping: [instance] TASK [os_must_gather : Check for oc command] *********************************** Friday 27 February 2026 12:06:01 +0000 (0:00:00.029) 0:00:01.393 ******* Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_000_check_for_oc.log changed: [instance] TASK [os_must_gather : Check if kubeconfig exists] ***************************** Friday 27 February 2026 12:06:01 +0000 (0:00:00.099) 0:00:01.492 ******* ok: [instance] TASK [os_must_gather : Run openstack-must-gather command] ********************** Friday 27 February 2026 12:06:02 +0000 (0:00:00.353) 0:00:01.845 ******* Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_001_run_openstack_must_gather.log changed: [instance] TASK [os_must_gather : Find existing os-must-gather directories] *************** Friday 27 February 2026 12:08:54 +0000 (0:02:52.163) 0:02:54.009 ******* ok: [instance] TASK [os_must_gather : Create a symlink to newest os-must-gather directory] **** Friday 27 February 2026 12:08:54 +0000 (0:00:00.395) 0:02:54.405 ******* changed: [instance] TASK [os_must_gather : Collect pod usage] ************************************** Friday 27 February 2026 12:08:54 +0000 (0:00:00.252) 0:02:54.657 ******* included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/os_must_gather/tasks/get_top.yml for instance TASK [os_must_gather : Get all containers usage - sort by cpu] ***************** Friday 27 February 2026 12:08:54 +0000 (0:00:00.053) 0:02:54.711 ******* fatal: [instance]: FAILED! => changed=true cmd: |- oc adm top pods --all-namespaces --sort-by=cpu --containers > /home/zuul/ci-framework-data/logs/openstack-must-gather/latest/all-containers-cpu-top.log delta: '0:00:00.150567' end: '2026-02-27 12:08:55.371084' msg: non-zero return code rc: 1 start: '2026-02-27 12:08:55.220517' stderr: 'error: Metrics API not available' stderr_lines: stdout: '' stdout_lines: ...ignoring TASK [os_must_gather : Print message when metrics are not available] *********** Friday 27 February 2026 12:08:55 +0000 (0:00:00.526) 0:02:55.237 ******* skipping: [instance] TASK [os_must_gather : Get all containers usage - sort by memory] ************** Friday 27 February 2026 12:08:55 +0000 (0:00:00.029) 0:02:55.267 ******* skipping: [instance] TASK [os_must_gather : Find all namespaces directories] ************************ Friday 27 February 2026 12:08:55 +0000 (0:00:00.027) 0:02:55.294 ******* skipping: [instance] TASK [os_must_gather : Get resource usage by pods per namespace] *************** Friday 27 February 2026 12:08:55 +0000 (0:00:00.028) 0:02:55.323 ******* skipping: [instance] TASK [os_must_gather : Get node resource usage] ******************************** Friday 27 February 2026 12:08:55 +0000 (0:00:00.028) 0:02:55.351 ******* skipping: [instance] PLAY RECAP ********************************************************************* instance : ok=9 changed=5 unreachable=0 failed=0 skipped=11 rescued=0 ignored=1 Friday 27 February 2026 12:08:55 +0000 (0:00:00.057) 0:02:55.409 ******* =============================================================================== os_must_gather : Run openstack-must-gather command -------------------- 172.16s Gathering Facts --------------------------------------------------------- 0.89s os_must_gather : Get all containers usage - sort by cpu ----------------- 0.53s os_must_gather : Find existing os-must-gather directories --------------- 0.40s os_must_gather : Check if kubeconfig exists ----------------------------- 0.35s os_must_gather : Ensure directories are present ------------------------- 0.33s os_must_gather : Create a symlink to newest os-must-gather directory ---- 0.25s os_must_gather : Check for oc command ----------------------------------- 0.10s os_must_gather : Get node resource usage -------------------------------- 0.06s os_must_gather : Collect pod usage -------------------------------------- 0.05s os_must_gather : Set cifmw_os_must_gather_image to new image tag -------- 0.03s os_must_gather : Print message when metrics are not available ----------- 0.03s os_must_gather : Find all namespaces directories ------------------------ 0.03s os_must_gather : Get resource usage by pods per namespace --------------- 0.03s os_must_gather : Debug git show-ref ------------------------------------- 0.03s os_must_gather : Get all containers usage - sort by memory -------------- 0.03s os_must_gather : Get git tag for image tagging -------------------------- 0.02s os_must_gather : Construct project change list -------------------------- 0.02s os_must_gather : Build openstack-must-gather container ------------------ 0.02s os_must_gather : Push openstack-must-gather container ------------------- 0.02s