2025-10-14T08:16:48.788260949+00:00 stderr F + sudo -E kolla_set_configs 2025-10-14T08:16:48.801706854+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-10-14T08:16:48.862405647+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-14T08:16:48.862744736+00:00 stderr F INFO:__main__:Validating config file 2025-10-14T08:16:48.862744736+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-14T08:16:48.862744736+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-14T08:16:48.863391302+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-14T08:16:48.863966487+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-14T08:16:48.864683307+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-14T08:16:48.864955074+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-14T08:16:48.865211051+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-14T08:16:48.865485288+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-14T08:16:48.865731614+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-14T08:16:48.865857588+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-14T08:16:48.865978181+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-14T08:16:48.874291220+00:00 stderr F ++ cat /run_command 2025-10-14T08:16:48.876708014+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-14T08:16:48.876728855+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-14T08:16:48.876728855+00:00 stderr F + ARGS= 2025-10-14T08:16:48.876728855+00:00 stderr F + [[ ! -n '' ]] 2025-10-14T08:16:48.876728855+00:00 stderr F + . kolla_extend_start 2025-10-14T08:16:48.876728855+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-14T08:16:48.876728855+00:00 stderr F + umask 0022 2025-10-14T08:16:48.876728855+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-14T08:16:48.887238052+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-10-14T08:16:48.887293314+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-14T08:16:48.887443068+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-14T08:16:48.887516790+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-14T08:16:48.887973162+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-14T08:16:49.201208201+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-10-14T08:16:49.201208201+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-10-14T08:16:49.201718644+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-14T08:16:49.201982801+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-14T08:16:49.202063133+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-14T08:16:49.202147615+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-14T08:16:49.202224657+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-14T08:16:49.202265308+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-14T08:16:49.202307190+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-14T08:16:49.202401022+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-14T08:16:49.202401022+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-14T08:17:03.908946813+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-10-14T08:17:03.908946813+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-10-14T08:17:03.908946813+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:03.909446176+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:03.909446176+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:03.909548158+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:03.909548158+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:03.909561739+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:03.909658581+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:03.909658581+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:03.909740613+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-10-14T08:17:04.739139349+00:00 stderr F + sudo -E kolla_set_configs 2025-10-14T08:17:04.754088884+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-10-14T08:17:04.817146318+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-14T08:17:04.817358154+00:00 stderr F INFO:__main__:Validating config file 2025-10-14T08:17:04.817402425+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-14T08:17:04.817429166+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-14T08:17:04.817563079+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-14T08:17:04.818100894+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-14T08:17:04.818846793+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-14T08:17:04.819106540+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-14T08:17:04.819396278+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-14T08:17:04.819611373+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-14T08:17:04.819845049+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-14T08:17:04.819964943+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-14T08:17:04.820358503+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-14T08:17:04.827773899+00:00 stderr F ++ cat /run_command 2025-10-14T08:17:04.830148222+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-14T08:17:04.830169732+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-14T08:17:04.830169732+00:00 stderr F + ARGS= 2025-10-14T08:17:04.830169732+00:00 stderr F + [[ ! -n '' ]] 2025-10-14T08:17:04.830169732+00:00 stderr F + . kolla_extend_start 2025-10-14T08:17:04.830169732+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-14T08:17:04.830169732+00:00 stderr F + umask 0022 2025-10-14T08:17:04.830169732+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-14T08:17:04.843783622+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-10-14T08:17:04.844355337+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-14T08:17:04.844474300+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-14T08:17:04.844554612+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-14T08:17:04.845394204+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-14T08:17:05.023124066+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-14T08:17:05.023367063+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-14T08:17:05.023407734+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-14T08:17:05.023448635+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-14T08:17:05.023490246+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-14T08:17:05.023531657+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-14T08:17:05.023574318+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-14T08:17:05.023749593+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-14T08:17:05.023749593+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-14T08:17:05.576948396+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.105 2025-10-14T08:17:05.577024038+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x55b5696e8d10 id: a37911f7-2045-45dd-a158-f99b9164a3b2 2025-10-14T08:17:06.120980579+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-10-14T08:17:18.684806215+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-10-14T08:17:18.725572820+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:2' not in cache 2025-10-14T08:17:18.808617943+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-10-14T08:17:28.117187142+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-10-14T08:17:32.154674088+00:00 stderr F (log_op_output) info: redis_start_0[56] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-10-14T08:17:32.154674088+00:00 stderr F (log_finished) info: redis start (call 8, PID 56) exited with status 0 (execution time 4.037s) 2025-10-14T08:17:32.234845594+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-10-14T08:17:32.289063556+00:00 stderr F (log_finished) info: redis notify (call 38, PID 218) exited with status 0 (execution time 54ms) 2025-10-14T08:17:32.474956893+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-10-14T08:17:32.540984896+00:00 stderr F (log_finished) info: redis notify (call 39, PID 264) exited with status 0 (execution time 66ms) 2025-10-14T08:17:33.626352899+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:40 2025-10-14T08:17:37.189935904+00:00 stderr F (log_op_output) info: redis_notify_0[310] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-10-14T08:17:37.189935904+00:00 stderr F (log_finished) info: redis notify (call 40, PID 310) exited with status 0 (execution time 3.565s) 2025-10-14T09:21:41.482223525+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:788 2025-10-14T09:21:41.553451296+00:00 stderr F (log_finished) info: redis notify (call 788, PID 9163) exited with status 0 (execution time 71ms) 2025-10-14T09:21:41.847950936+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:789 2025-10-14T09:21:41.922095847+00:00 stderr F (log_finished) info: redis notify (call 789, PID 9209) exited with status 0 (execution time 75ms) 2025-10-14T09:21:42.073079444+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:790 2025-10-14T09:21:42.145791061+00:00 stderr F (log_finished) info: redis notify (call 790, PID 9255) exited with status 0 (execution time 72ms) 2025-10-14T09:21:42.707889103+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:791 2025-10-14T09:21:42.772974552+00:00 stderr F (log_finished) info: redis notify (call 791, PID 9301) exited with status 0 (execution time 65ms) 2025-10-14T09:21:42.921962796+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:792 2025-10-14T09:21:42.974991529+00:00 stderr F (log_finished) info: redis notify (call 792, PID 9347) exited with status 0 (execution time 53ms) 2025-10-14T09:25:03.381840714+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:800 2025-10-14T09:25:03.451123015+00:00 stderr F (log_finished) info: redis notify (call 800, PID 9810) exited with status 0 (execution time 70ms) 2025-10-14T09:25:03.855192709+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:801 2025-10-14T09:25:03.931589591+00:00 stderr F (log_finished) info: redis notify (call 801, PID 9856) exited with status 0 (execution time 77ms) 2025-10-14T09:25:04.364172840+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:802 2025-10-14T09:25:04.444369480+00:00 stderr F (log_finished) info: redis notify (call 802, PID 9902) exited with status 0 (execution time 80ms) 2025-10-14T09:25:04.826869143+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:803 2025-10-14T09:25:04.895012369+00:00 stderr F (log_finished) info: redis notify (call 803, PID 9948) exited with status 0 (execution time 69ms) 2025-10-14T09:25:04.937546189+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_45000 2025-10-14T09:25:05.054553462+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_60000 2025-10-14T09:25:05.137719603+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:806 2025-10-14T09:25:05.446882641+00:00 stderr F (log_finished) info: redis stop (call 806, PID 9994) exited with status 0 (execution time 309ms) 2025-10-14T09:25:06.543508734+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:812 2025-10-14T09:28:26.545777381+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[10047] timed out after 3m20s 2025-10-14T09:28:26.545777381+00:00 stderr F (log_finished) info: redis start (call 812, PID 10047) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-10-14T09:28:26.595901481+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:820 2025-10-14T09:28:26.669175481+00:00 stderr F (log_finished) info: redis notify (call 820, PID 10315) exited with status 0 (execution time 73ms) 2025-10-14T09:28:26.839111368+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:821 2025-10-14T09:28:26.901600572+00:00 stderr F (log_finished) info: redis notify (call 821, PID 10361) exited with status 0 (execution time 63ms) 2025-10-14T09:28:26.960695221+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:822 2025-10-14T09:28:27.275437133+00:00 stderr F (log_finished) info: redis stop (call 822, PID 10407) exited with status 0 (execution time 314ms)