2025-11-28T14:27:44.193174021+00:00 stderr F + sudo -E kolla_set_configs 2025-11-28T14:27:44.209340699+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-28T14:27:44.255740963+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-28T14:27:44.255928239+00:00 stderr F INFO:__main__:Validating config file 2025-11-28T14:27:44.255961800+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-28T14:27:44.255973110+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-28T14:27:44.256123365+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-28T14:27:44.256763804+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-28T14:27:44.257649512+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-28T14:27:44.257728375+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-28T14:27:44.257990152+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-28T14:27:44.258249590+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-28T14:27:44.258482738+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-28T14:27:44.258642342+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-28T14:27:44.258747096+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-28T14:27:44.266713002+00:00 stderr F ++ cat /run_command 2025-11-28T14:27:44.268920130+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-28T14:27:44.268941661+00:00 stderr F + ARGS= 2025-11-28T14:27:44.268979202+00:00 stderr F + [[ ! -n '' ]] 2025-11-28T14:27:44.268979202+00:00 stderr F + . kolla_extend_start 2025-11-28T14:27:44.269134077+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-28T14:27:44.269147957+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-28T14:27:44.269147957+00:00 stderr F + umask 0022 2025-11-28T14:27:44.269160307+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-28T14:27:44.279030622+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-11-28T14:27:44.279079593+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-28T14:27:44.279249098+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-28T14:27:44.279318261+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-28T14:27:44.279785845+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-28T14:27:44.553235021+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-11-28T14:27:44.553235021+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-11-28T14:27:44.553775298+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-28T14:27:44.553882451+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-28T14:27:44.553921442+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-28T14:27:44.553983914+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-28T14:27:44.554022215+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-28T14:27:44.554070197+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-28T14:27:44.554160929+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-28T14:27:44.554218761+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-28T14:27:44.554218761+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-28T14:27:49.136704277+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-11-28T14:27:49.136704277+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-11-28T14:27:49.136704277+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T14:27:49.137171201+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T14:27:49.137231223+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T14:27:49.137245323+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T14:27:49.137307215+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T14:27:49.137320925+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T14:27:49.137370677+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T14:27:49.137409868+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T14:27:49.137499702+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-11-28T14:27:49.938204232+00:00 stderr F + sudo -E kolla_set_configs 2025-11-28T14:27:49.950402269+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Validating config file 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-28T14:27:50.017145881+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-28T14:27:50.021743372+00:00 stderr F ++ cat /run_command 2025-11-28T14:27:50.023500037+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-28T14:27:50.023542648+00:00 stderr F + ARGS= 2025-11-28T14:27:50.023587319+00:00 stderr F + [[ ! -n '' ]] 2025-11-28T14:27:50.023592790+00:00 stderr F + . kolla_extend_start 2025-11-28T14:27:50.023748224+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-28T14:27:50.023754155+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-28T14:27:50.023783425+00:00 stderr F + umask 0022 2025-11-28T14:27:50.023807616+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-28T14:27:50.030121491+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-11-28T14:27:50.030121491+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-28T14:27:50.030121491+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-28T14:27:50.030121491+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-28T14:27:50.030121491+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-28T14:27:50.329937291+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-28T14:27:50.330161398+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-28T14:27:50.330226680+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-28T14:27:50.330284122+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-28T14:27:50.330346974+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-28T14:27:50.330403685+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-28T14:27:50.330467127+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-28T14:27:50.330611282+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-28T14:27:50.330631642+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-28T14:27:50.677540087+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-11-28T14:27:50.678272600+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x563582e943e0 id: 576ca81d-6476-4a64-9e07-9537ccd3f9a7 2025-11-28T14:27:51.258868893+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-11-28T14:27:51.390445527+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-11-28T14:27:51.431435352+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-11-28T14:27:51.513642372+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-11-28T14:27:51.937405120+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-11-28T14:27:55.938380294+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-11-28T14:27:55.938380294+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 4.001s) 2025-11-28T14:27:56.015847017+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-11-28T14:27:56.090716670+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 74ms) 2025-11-28T14:27:56.183726412+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-11-28T14:27:56.258674397+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 74ms) 2025-11-28T14:27:56.305052259+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-11-28T14:27:57.197705950+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 896ms) 2025-11-28T14:27:57.277655909+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-11-28T14:27:57.602820182+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 325ms) 2025-11-28T15:33:03.170350110+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:957 2025-11-28T15:33:03.241867732+00:00 stderr F (log_finished) info: redis notify (call 957, PID 11693) exited with status 0 (execution time 72ms) 2025-11-28T15:33:03.284440498+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-11-28T15:33:03.368003642+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:959 2025-11-28T15:33:03.468333404+00:00 stderr F (log_finished) info: redis demote (call 959, PID 11739) exited with status 7 (execution time 100ms) 2025-11-28T15:33:03.514632167+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:960 2025-11-28T15:33:03.591494363+00:00 stderr F (log_finished) info: redis notify (call 960, PID 11801) exited with status 0 (execution time 76ms) 2025-11-28T15:33:03.690633860+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:961 2025-11-28T15:33:03.759082036+00:00 stderr F (log_finished) info: redis notify (call 961, PID 11847) exited with status 0 (execution time 69ms) 2025-11-28T15:33:03.802636104+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:962 2025-11-28T15:33:04.110255027+00:00 stderr F (log_finished) info: redis stop (call 962, PID 11893) exited with status 0 (execution time 307ms) 2025-11-28T15:33:04.324380899+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:968 2025-11-28T15:36:24.326761584+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11946] timed out after 3m20s 2025-11-28T15:36:24.326761584+00:00 stderr F (log_finished) info: redis start (call 968, PID 11946) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-11-28T15:36:24.374222981+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:975 2025-11-28T15:36:24.440855172+00:00 stderr F (log_finished) info: redis notify (call 975, PID 12215) exited with status 0 (execution time 67ms) 2025-11-28T15:36:24.559254824+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:976 2025-11-28T15:36:24.635410969+00:00 stderr F (log_finished) info: redis notify (call 976, PID 12261) exited with status 0 (execution time 76ms) 2025-11-28T15:36:24.679761150+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:977 2025-11-28T15:36:24.777848644+00:00 stderr F (log_finished) info: redis demote (call 977, PID 12307) exited with status 7 (execution time 99ms) 2025-11-28T15:36:24.823793004+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:978 2025-11-28T15:36:24.886463403+00:00 stderr F (log_finished) info: redis notify (call 978, PID 12369) exited with status 0 (execution time 62ms) 2025-11-28T15:36:24.991809210+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:979 2025-11-28T15:36:25.066340396+00:00 stderr F (log_finished) info: redis notify (call 979, PID 12415) exited with status 0 (execution time 74ms) 2025-11-28T15:36:25.108734447+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:980 2025-11-28T15:36:25.407800896+00:00 stderr F (log_finished) info: redis stop (call 980, PID 12461) exited with status 0 (execution time 299ms)