2025-10-08T19:12:12.897667821+00:00 stderr F + sudo -E kolla_set_configs 2025-10-08T19:12:12.913072570+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-10-08T19:12:12.977347899+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-08T19:12:12.977347899+00:00 stderr F INFO:__main__:Validating config file 2025-10-08T19:12:12.977347899+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-08T19:12:12.977347899+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-08T19:12:12.977347899+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-08T19:12:12.978402293+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-08T19:12:12.978402293+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-08T19:12:12.978402293+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-10-08T19:12:12.978535597+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-10-08T19:12:12.978707062+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-08T19:12:12.978915109+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-08T19:12:12.979070914+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-08T19:12:12.979271440+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-08T19:12:12.979401694+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-08T19:12:12.979501017+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-08T19:12:12.985171627+00:00 stderr F ++ cat /run_command 2025-10-08T19:12:12.986989115+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-08T19:12:12.986989115+00:00 stderr F + ARGS= 2025-10-08T19:12:12.987016626+00:00 stderr F + [[ ! -n '' ]] 2025-10-08T19:12:12.987016626+00:00 stderr F + . kolla_extend_start 2025-10-08T19:12:12.987191511+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-08T19:12:12.987198411+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-08T19:12:12.987233113+00:00 stderr F + umask 0022 2025-10-08T19:12:12.987249953+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-08T19:12:12.998123088+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-10-08T19:12:12.998179490+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-08T19:12:12.998291993+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-08T19:12:12.998425008+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-08T19:12:12.998870391+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-08T19:12:13.352776437+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-10-08T19:12:13.352776437+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-10-08T19:12:13.352921312+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-08T19:12:13.353152310+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-08T19:12:13.353201322+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-08T19:12:13.353252733+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-08T19:12:13.353336746+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-08T19:12:13.353358237+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-08T19:12:13.353408148+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-08T19:12:13.353460510+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-08T19:12:13.353460510+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-08T19:12:17.969840005+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-10-08T19:12:17.969840005+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-10-08T19:12:17.969840005+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T19:12:17.969840005+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T19:12:17.969840005+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T19:12:17.969840005+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T19:12:17.969840005+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T19:12:17.969840005+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T19:12:17.969840005+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T19:12:17.969840005+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T19:12:17.969840005+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-10-08T19:12:18.601345177+00:00 stderr F + sudo -E kolla_set_configs 2025-10-08T19:12:18.609209106+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-10-08T19:12:18.656309801+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-08T19:12:18.656553168+00:00 stderr F INFO:__main__:Validating config file 2025-10-08T19:12:18.656594080+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-08T19:12:18.656607470+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-08T19:12:18.656750575+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-08T19:12:18.657463017+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-08T19:12:18.658202060+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-08T19:12:18.659017297+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-10-08T19:12:18.659239904+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-10-08T19:12:18.659492842+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-08T19:12:18.659743339+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-08T19:12:18.659978547+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-08T19:12:18.660253225+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-08T19:12:18.660412110+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-08T19:12:18.660561455+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-08T19:12:18.668802537+00:00 stderr F ++ cat /run_command 2025-10-08T19:12:18.671915815+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-08T19:12:18.671915815+00:00 stderr F + ARGS= 2025-10-08T19:12:18.671933396+00:00 stderr F + [[ ! -n '' ]] 2025-10-08T19:12:18.671933396+00:00 stderr F + . kolla_extend_start 2025-10-08T19:12:18.672052020+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-08T19:12:18.672060930+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-08T19:12:18.672060930+00:00 stderr F + umask 0022 2025-10-08T19:12:18.672060930+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-08T19:12:18.677820092+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-10-08T19:12:18.678012498+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-08T19:12:18.678044929+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-08T19:12:18.678076280+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-08T19:12:18.678575597+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-08T19:12:19.000546069+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-08T19:12:19.000546069+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-08T19:12:19.000546069+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-08T19:12:19.000546069+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-08T19:12:19.000546069+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-08T19:12:19.000546069+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-08T19:12:19.000603651+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-08T19:12:19.000786988+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-08T19:12:19.000834699+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-08T19:12:19.403291575+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-10-08T19:12:19.403711508+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x56409eb82d00 id: ef73e527-6656-4c16-be86-f7da82e90089 2025-10-08T19:12:19.946857867+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-10-08T19:12:20.127164697+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-10-08T19:12:20.168763606+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-10-08T19:12:20.250750898+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-10-08T19:12:20.668819299+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-10-08T19:12:24.687697041+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-10-08T19:12:24.687789084+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 4.019s) 2025-10-08T19:12:24.766123259+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-10-08T19:12:24.832118372+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 67ms) 2025-10-08T19:12:24.910888921+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-10-08T19:12:24.976384389+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 65ms) 2025-10-08T19:12:25.018964559+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-10-08T19:12:25.939043654+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 921ms) 2025-10-08T19:12:26.018783434+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-10-08T19:12:26.357357784+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 338ms) 2025-10-08T20:16:30.352881283+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:943 2025-10-08T20:16:30.424046484+00:00 stderr F (log_finished) info: redis notify (call 943, PID 11517) exited with status 0 (execution time 72ms) 2025-10-08T20:16:30.466530073+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-10-08T20:16:30.550693758+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:945 2025-10-08T20:16:30.652224043+00:00 stderr F (log_finished) info: redis demote (call 945, PID 11563) exited with status 7 (execution time 101ms) 2025-10-08T20:16:30.697922902+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:946 2025-10-08T20:16:30.769236897+00:00 stderr F (log_finished) info: redis notify (call 946, PID 11625) exited with status 0 (execution time 71ms) 2025-10-08T20:16:30.865261371+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:947 2025-10-08T20:16:30.940572441+00:00 stderr F (log_finished) info: redis notify (call 947, PID 11671) exited with status 0 (execution time 75ms) 2025-10-08T20:16:30.984086662+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:948 2025-10-08T20:16:31.296459206+00:00 stderr F (log_finished) info: redis stop (call 948, PID 11717) exited with status 0 (execution time 312ms) 2025-10-08T20:16:31.521928550+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:954 2025-10-08T20:19:51.523549343+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11770] timed out after 3m20s 2025-10-08T20:19:51.523549343+00:00 stderr F (log_finished) info: redis start (call 954, PID 11770) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-10-08T20:20:04.550120627+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:962 2025-10-08T20:20:04.621785227+00:00 stderr F (log_finished) info: redis notify (call 962, PID 12039) exited with status 0 (execution time 72ms) 2025-10-08T20:20:04.740759031+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:963 2025-10-08T20:20:04.804940109+00:00 stderr F (log_finished) info: redis notify (call 963, PID 12085) exited with status 0 (execution time 64ms) 2025-10-08T20:20:04.847622557+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:964 2025-10-08T20:20:04.928934628+00:00 stderr F (log_finished) info: redis demote (call 964, PID 12131) exited with status 7 (execution time 81ms) 2025-10-08T20:20:04.973781094+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:965 2025-10-08T20:20:05.052777483+00:00 stderr F (log_finished) info: redis notify (call 965, PID 12193) exited with status 0 (execution time 78ms) 2025-10-08T20:20:05.150909468+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:966 2025-10-08T20:20:05.224439186+00:00 stderr F (log_finished) info: redis notify (call 966, PID 12239) exited with status 0 (execution time 73ms) 2025-10-08T20:20:05.266808666+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:967 2025-10-08T20:20:05.577529828+00:00 stderr F (log_finished) info: redis stop (call 967, PID 12285) exited with status 0 (execution time 310ms)