2025-11-23T15:35:53.206996807+00:00 stderr F + sudo -E kolla_set_configs 2025-11-23T15:35:53.220348929+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-23T15:35:53.281859269+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-23T15:35:53.282062175+00:00 stderr F INFO:__main__:Validating config file 2025-11-23T15:35:53.282083525+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-23T15:35:53.282097606+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-23T15:35:53.282236989+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-23T15:35:53.282853635+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-23T15:35:53.283596605+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-23T15:35:53.283857512+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-23T15:35:53.284110228+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-23T15:35:53.284340324+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-23T15:35:53.284627362+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-23T15:35:53.284747835+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-23T15:35:53.284870319+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-23T15:35:53.292735335+00:00 stderr F ++ cat /run_command 2025-11-23T15:35:53.294901943+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-23T15:35:53.294901943+00:00 stderr F + ARGS= 2025-11-23T15:35:53.294984845+00:00 stderr F + [[ ! -n '' ]] 2025-11-23T15:35:53.294984845+00:00 stderr F + . kolla_extend_start 2025-11-23T15:35:53.295165679+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-23T15:35:53.295175300+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-23T15:35:53.295175300+00:00 stderr F + umask 0022 2025-11-23T15:35:53.295209431+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-23T15:35:53.311871680+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-11-23T15:35:53.311955002+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-23T15:35:53.312095935+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-23T15:35:53.312175327+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-23T15:35:53.312837616+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-23T15:35:53.628258025+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-11-23T15:35:53.628258025+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-11-23T15:35:53.628842300+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-23T15:35:53.629457407+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-23T15:35:53.629529169+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-23T15:35:53.629604591+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-23T15:35:53.629650902+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-23T15:35:53.629703113+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-23T15:35:53.629755944+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-23T15:35:53.629846197+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-23T15:35:53.629846197+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-23T15:35:58.454566539+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-11-23T15:35:58.454566539+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-11-23T15:35:58.454566539+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-23T15:35:58.454832476+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-23T15:35:58.454832476+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-23T15:35:58.454879777+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-23T15:35:58.454911758+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-23T15:35:58.454942859+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-23T15:35:58.454956399+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-23T15:35:58.455004990+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-23T15:35:58.455089943+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-11-23T15:35:59.173823637+00:00 stderr F + sudo -E kolla_set_configs 2025-11-23T15:35:59.185470084+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-23T15:35:59.245480164+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-23T15:35:59.245671269+00:00 stderr F INFO:__main__:Validating config file 2025-11-23T15:35:59.245707870+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-23T15:35:59.245718401+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-23T15:35:59.245847454+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-23T15:35:59.246396079+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-23T15:35:59.247080967+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-23T15:35:59.247334044+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-23T15:35:59.247602551+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-23T15:35:59.247815396+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-23T15:35:59.248052032+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-23T15:35:59.248172915+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-23T15:35:59.248307899+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-23T15:35:59.258628771+00:00 stderr F ++ cat /run_command 2025-11-23T15:35:59.258628771+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-23T15:35:59.258628771+00:00 stderr F + ARGS= 2025-11-23T15:35:59.258628771+00:00 stderr F + [[ ! -n '' ]] 2025-11-23T15:35:59.258628771+00:00 stderr F + . kolla_extend_start 2025-11-23T15:35:59.258726324+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-23T15:35:59.258736184+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-23T15:35:59.258736184+00:00 stderr F + umask 0022 2025-11-23T15:35:59.258736184+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-23T15:35:59.264872145+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-11-23T15:35:59.265111892+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-23T15:35:59.265167563+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-23T15:35:59.265195934+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-23T15:35:59.265563623+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-23T15:35:59.601315118+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-23T15:35:59.601315118+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-23T15:35:59.601315118+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-23T15:35:59.601315118+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-23T15:35:59.601315118+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-23T15:35:59.601315118+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-23T15:35:59.601315118+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-23T15:35:59.601315118+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-23T15:35:59.601315118+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-23T15:36:00.001470940+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-11-23T15:36:00.001470940+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x564eb5900450 id: 50110fc0-4c2d-461c-a0e2-3153b18e705d 2025-11-23T15:36:00.544178848+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-11-23T15:36:00.699742705+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-11-23T15:36:00.741003183+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-11-23T15:36:00.822814558+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-11-23T15:36:01.237028290+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-11-23T15:36:05.255501973+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-11-23T15:36:05.255501973+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 4.018s) 2025-11-23T15:36:05.334186726+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-11-23T15:36:05.405526645+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 71ms) 2025-11-23T15:36:05.498043882+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-11-23T15:36:05.574942988+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 76ms) 2025-11-23T15:36:05.617957681+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-11-23T15:36:06.535870333+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 918ms) 2025-11-23T15:36:06.615029818+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-11-23T15:36:06.935138671+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 321ms) 2025-11-23T16:42:14.226450800+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:971 2025-11-23T16:42:14.297954578+00:00 stderr F (log_finished) info: redis notify (call 971, PID 11868) exited with status 0 (execution time 72ms) 2025-11-23T16:42:14.340679225+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-11-23T16:42:14.423866282+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:973 2025-11-23T16:42:14.524565470+00:00 stderr F (log_finished) info: redis demote (call 973, PID 11914) exited with status 7 (execution time 100ms) 2025-11-23T16:42:14.570875232+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:974 2025-11-23T16:42:14.638372014+00:00 stderr F (log_finished) info: redis notify (call 974, PID 11976) exited with status 0 (execution time 67ms) 2025-11-23T16:42:14.744934567+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:975 2025-11-23T16:42:14.818904379+00:00 stderr F (log_finished) info: redis notify (call 975, PID 12022) exited with status 0 (execution time 74ms) 2025-11-23T16:42:14.861867873+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:976 2025-11-23T16:42:15.171447395+00:00 stderr F (log_finished) info: redis stop (call 976, PID 12068) exited with status 0 (execution time 309ms) 2025-11-23T16:42:15.384539370+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:982 2025-11-23T16:45:35.386301712+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[12121] timed out after 3m20s 2025-11-23T16:45:35.386301712+00:00 stderr F (log_finished) info: redis start (call 982, PID 12121) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-11-23T16:45:45.213261115+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:990 2025-11-23T16:45:45.290243446+00:00 stderr F (log_finished) info: redis notify (call 990, PID 12390) exited with status 0 (execution time 78ms) 2025-11-23T16:45:45.408067697+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:991 2025-11-23T16:45:45.483496988+00:00 stderr F (log_finished) info: redis notify (call 991, PID 12436) exited with status 0 (execution time 75ms) 2025-11-23T16:45:45.527178771+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:992 2025-11-23T16:45:45.630398786+00:00 stderr F (log_finished) info: redis demote (call 992, PID 12482) exited with status 7 (execution time 103ms) 2025-11-23T16:45:45.677146309+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:993 2025-11-23T16:45:45.749169190+00:00 stderr F (log_finished) info: redis notify (call 993, PID 12544) exited with status 0 (execution time 72ms) 2025-11-23T16:45:45.850084004+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:994 2025-11-23T16:45:45.927700243+00:00 stderr F (log_finished) info: redis notify (call 994, PID 12590) exited with status 0 (execution time 77ms) 2025-11-23T16:45:45.971070027+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:995 2025-11-23T16:45:46.283197636+00:00 stderr F (log_finished) info: redis stop (call 995, PID 12636) exited with status 0 (execution time 312ms)