2025-10-14T08:16:48.798109825+00:00 stderr F + sudo -E kolla_set_configs 2025-10-14T08:16:48.814459749+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-10-14T08:16:48.874028594+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-14T08:16:48.874242551+00:00 stderr F INFO:__main__:Validating config file 2025-10-14T08:16:48.874267021+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-14T08:16:48.874310203+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-14T08:16:48.874420536+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-14T08:16:48.875058896+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-14T08:16:48.875857931+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-14T08:16:48.876100088+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-14T08:16:48.876349386+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-14T08:16:48.876597813+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-14T08:16:48.876850881+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-14T08:16:48.876973235+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-14T08:16:48.877089798+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-14T08:16:48.885206239+00:00 stderr F ++ cat /run_command 2025-10-14T08:16:48.887436318+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-14T08:16:48.887457028+00:00 stderr F + ARGS= 2025-10-14T08:16:48.887566162+00:00 stderr F + [[ ! -n '' ]] 2025-10-14T08:16:48.887566162+00:00 stderr F + . kolla_extend_start 2025-10-14T08:16:48.887760057+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-14T08:16:48.887810859+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-14T08:16:48.887822469+00:00 stderr F + umask 0022 2025-10-14T08:16:48.887852110+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-14T08:16:48.901653476+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-10-14T08:16:48.901785010+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-14T08:16:48.901921954+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-14T08:16:48.902003546+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-14T08:16:48.902671847+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-14T08:16:49.019853528+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-10-14T08:16:49.019903509+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-10-14T08:16:49.020551699+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-14T08:16:49.020641792+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-14T08:16:49.020693694+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-14T08:16:49.020743175+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-14T08:16:49.020795287+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-14T08:16:49.020842388+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-14T08:16:49.020896630+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-14T08:16:49.020958862+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-14T08:16:49.020958862+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-14T08:17:04.007266355+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-10-14T08:17:04.007299296+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-10-14T08:17:04.007299296+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:04.007714338+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:04.007801531+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:04.007853072+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:04.007890004+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:04.007942425+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:04.007976686+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:04.008021258+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-14T08:17:04.008105390+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-10-14T08:17:04.645294036+00:00 stderr F + sudo -E kolla_set_configs 2025-10-14T08:17:04.658324517+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-10-14T08:17:04.693523922+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-14T08:17:04.693741979+00:00 stderr F INFO:__main__:Validating config file 2025-10-14T08:17:04.693790060+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-14T08:17:04.693811711+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-14T08:17:04.693909144+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-14T08:17:04.694388488+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-14T08:17:04.694951925+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-14T08:17:04.695148762+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-14T08:17:04.695331818+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-14T08:17:04.695639537+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-14T08:17:04.695826673+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-14T08:17:04.695915106+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-14T08:17:04.696016559+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-14T08:17:04.702584841+00:00 stderr F ++ cat /run_command 2025-10-14T08:17:04.704010465+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-14T08:17:04.704010465+00:00 stderr F + ARGS= 2025-10-14T08:17:04.704094128+00:00 stderr F + [[ ! -n '' ]] 2025-10-14T08:17:04.704094128+00:00 stderr F + . kolla_extend_start 2025-10-14T08:17:04.704294614+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-14T08:17:04.704301634+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-14T08:17:04.704337815+00:00 stderr F + umask 0022 2025-10-14T08:17:04.704364946+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-14T08:17:04.716577422+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-10-14T08:17:04.716766828+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-14T08:17:04.716780708+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-14T08:17:04.716815549+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-14T08:17:04.717137099+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-14T08:17:05.073258024+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-14T08:17:05.073512292+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-14T08:17:05.073566394+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-14T08:17:05.073613575+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-14T08:17:05.073655696+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-14T08:17:05.073696958+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-14T08:17:05.073749459+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-14T08:17:05.073939485+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-14T08:17:05.073939485+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-14T08:17:05.341346215+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.104 2025-10-14T08:17:05.341346215+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x5610c27c5c90 id: eb240ec3-f23c-4c2e-8024-1b4f7b93cf60 2025-10-14T08:17:05.883811341+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-10-14T08:17:18.687282971+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-10-14T08:17:18.731990419+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:1' not in cache 2025-10-14T08:17:18.813839061+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-10-14T08:17:23.616131928+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-10-14T08:17:27.747917762+00:00 stderr F (log_op_output) info: redis_start_0[56] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-10-14T08:17:27.747917762+00:00 stderr F (log_finished) info: redis start (call 8, PID 56) exited with status 0 (execution time 4.131s) 2025-10-14T08:17:27.941118926+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-10-14T08:17:28.015357823+00:00 stderr F (log_finished) info: redis notify (call 38, PID 218) exited with status 0 (execution time 74ms) 2025-10-14T08:17:32.240966187+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-10-14T08:17:32.324939305+00:00 stderr F (log_finished) info: redis notify (call 39, PID 264) exited with status 0 (execution time 84ms) 2025-10-14T08:17:32.476207276+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:40 2025-10-14T08:17:32.550724753+00:00 stderr F (log_finished) info: redis notify (call 40, PID 310) exited with status 0 (execution time 74ms) 2025-10-14T08:17:33.625125212+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:41 2025-10-14T08:17:37.229835393+00:00 stderr F (log_op_output) info: redis_notify_0[356] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-10-14T08:17:37.229835393+00:00 stderr F (log_finished) info: redis notify (call 41, PID 356) exited with status 0 (execution time 3.605s) 2025-10-14T09:21:41.483924630+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:789 2025-10-14T09:21:41.561681554+00:00 stderr F (log_finished) info: redis notify (call 789, PID 9209) exited with status 0 (execution time 78ms) 2025-10-14T09:21:41.847311697+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:790 2025-10-14T09:21:41.911929981+00:00 stderr F (log_finished) info: redis notify (call 790, PID 9255) exited with status 0 (execution time 64ms) 2025-10-14T09:21:42.073934831+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_45000 2025-10-14T09:21:42.115925400+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_60000 2025-10-14T09:21:42.199086901+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:793 2025-10-14T09:21:42.270586540+00:00 stderr F (log_finished) info: redis notify (call 793, PID 9301) exited with status 0 (execution time 71ms) 2025-10-14T09:21:42.708721036+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:794 2025-10-14T09:21:42.792017493+00:00 stderr F (log_finished) info: redis notify (call 794, PID 9347) exited with status 0 (execution time 84ms) 2025-10-14T09:21:42.927469265+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:795 2025-10-14T09:21:43.000306635+00:00 stderr F (log_finished) info: redis notify (call 795, PID 9393) exited with status 0 (execution time 72ms) 2025-10-14T09:25:03.258208947+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:803 2025-10-14T09:25:03.334738598+00:00 stderr F (log_finished) info: redis notify (call 803, PID 9442) exited with status 0 (execution time 77ms) 2025-10-14T09:25:03.736416337+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:804 2025-10-14T09:25:03.809052857+00:00 stderr F (log_finished) info: redis notify (call 804, PID 9488) exited with status 0 (execution time 73ms) 2025-10-14T09:25:04.236533892+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:805 2025-10-14T09:25:04.316423556+00:00 stderr F (log_finished) info: redis notify (call 805, PID 9534) exited with status 0 (execution time 79ms) 2025-10-14T09:25:04.706331623+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:806 2025-10-14T09:25:04.780207972+00:00 stderr F (log_finished) info: redis notify (call 806, PID 9580) exited with status 0 (execution time 74ms) 2025-10-14T09:25:05.756741833+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:807 2025-10-14T09:25:05.823080929+00:00 stderr F (log_finished) info: redis notify (call 807, PID 9626) exited with status 0 (execution time 67ms) 2025-10-14T09:25:06.263270146+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:808 2025-10-14T09:25:06.327286741+00:00 stderr F (log_finished) info: redis notify (call 808, PID 9672) exited with status 0 (execution time 64ms) 2025-10-14T09:25:06.374404574+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:809 2025-10-14T09:25:06.446613621+00:00 stderr F (log_finished) info: redis notify (call 809, PID 9718) exited with status 0 (execution time 72ms) 2025-10-14T09:28:26.607004012+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:817 2025-10-14T09:28:26.681179282+00:00 stderr F (log_finished) info: redis notify (call 817, PID 9767) exited with status 0 (execution time 75ms) 2025-10-14T09:28:26.850034319+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:818 2025-10-14T09:28:26.923211497+00:00 stderr F (log_finished) info: redis notify (call 818, PID 9813) exited with status 0 (execution time 73ms) 2025-10-14T09:28:27.371018223+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:819 2025-10-14T09:28:27.446889146+00:00 stderr F (log_finished) info: redis notify (call 819, PID 9859) exited with status 0 (execution time 75ms) 2025-10-14T09:28:27.491963443+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:820 2025-10-14T09:28:27.573913184+00:00 stderr F (log_finished) info: redis notify (call 820, PID 9905) exited with status 0 (execution time 81ms) 2025-10-14T09:28:27.622001175+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:821 2025-10-14T09:28:27.709164818+00:00 stderr F (log_finished) info: redis promote (call 821, PID 9951) exited with status 1 (execution time 87ms) 2025-10-14T09:28:27.759986554+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:822 2025-10-14T09:28:27.823314678+00:00 stderr F (log_finished) info: redis notify (call 822, PID 10000) exited with status 0 (execution time 65ms) 2025-10-14T09:28:27.984104253+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:823 2025-10-14T09:28:28.062352780+00:00 stderr F (log_finished) info: redis notify (call 823, PID 10046) exited with status 0 (execution time 78ms) 2025-10-14T09:28:28.108028847+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:824 2025-10-14T09:28:28.207621924+00:00 stderr F (log_finished) info: redis demote (call 824, PID 10092) exited with status 7 (execution time 99ms) 2025-10-14T09:28:28.257197622+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:825 2025-10-14T09:28:28.334417217+00:00 stderr F (log_finished) info: redis notify (call 825, PID 10154) exited with status 0 (execution time 77ms) 2025-10-14T09:28:28.473198730+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:826 2025-10-14T09:28:28.539665121+00:00 stderr F (log_finished) info: redis notify (call 826, PID 10200) exited with status 0 (execution time 66ms) 2025-10-14T09:28:28.587537145+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:827 2025-10-14T09:28:28.909799558+00:00 stderr F (log_finished) info: redis stop (call 827, PID 10246) exited with status 0 (execution time 323ms) 2025-10-14T09:28:29.147140828+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:833 2025-10-14T09:31:49.149395431+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[10299] timed out after 3m20s 2025-10-14T09:31:49.149395431+00:00 stderr F (log_finished) info: redis start (call 833, PID 10299) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-10-14T09:31:49.202166524+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:840 2025-10-14T09:31:49.275682422+00:00 stderr F (log_finished) info: redis notify (call 840, PID 10568) exited with status 0 (execution time 73ms) 2025-10-14T09:31:49.428937790+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:841 2025-10-14T09:31:49.492130547+00:00 stderr F (log_finished) info: redis notify (call 841, PID 10614) exited with status 0 (execution time 63ms) 2025-10-14T09:31:49.539231203+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:842 2025-10-14T09:31:49.842939754+00:00 stderr F (log_finished) info: redis stop (call 842, PID 10660) exited with status 0 (execution time 304ms)