2025-11-28T17:08:00.418555511+00:00 stderr F + sudo -E kolla_set_configs 2025-11-28T17:08:00.431867639+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-28T17:08:00.478853977+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-28T17:08:00.479045432+00:00 stderr F INFO:__main__:Validating config file 2025-11-28T17:08:00.479062562+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-28T17:08:00.479093783+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-28T17:08:00.479211426+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-28T17:08:00.479853433+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-28T17:08:00.480949912+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-28T17:08:00.481300461+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-28T17:08:00.481638839+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-28T17:08:00.481950808+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-28T17:08:00.482294617+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-28T17:08:00.482417561+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-28T17:08:00.482534714+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-28T17:08:00.489046714+00:00 stderr F ++ cat /run_command 2025-11-28T17:08:00.491761705+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-28T17:08:00.491761705+00:00 stderr F + ARGS= 2025-11-28T17:08:00.491761705+00:00 stderr F + [[ ! -n '' ]] 2025-11-28T17:08:00.491761705+00:00 stderr F + . kolla_extend_start 2025-11-28T17:08:00.492492813+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-28T17:08:00.492506734+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-28T17:08:00.492506734+00:00 stderr F + umask 0022 2025-11-28T17:08:00.492506734+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-28T17:08:00.501315024+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-11-28T17:08:00.501386186+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-28T17:08:00.501501349+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-28T17:08:00.501572791+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-28T17:08:00.502159057+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-28T17:08:00.733688740+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-11-28T17:08:00.733688740+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-11-28T17:08:00.733688740+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-28T17:08:00.733688740+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-28T17:08:00.733787902+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-28T17:08:00.733787902+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-28T17:08:00.733837374+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-28T17:08:00.733904345+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-28T17:08:00.733916436+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-28T17:08:00.734003778+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-28T17:08:00.734003778+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-28T17:08:05.038895280+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-11-28T17:08:05.038895280+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-11-28T17:08:05.038895280+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T17:08:05.039074465+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T17:08:05.039139957+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T17:08:05.039171618+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T17:08:05.039212579+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T17:08:05.039252460+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T17:08:05.039292991+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T17:08:05.039333042+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-28T17:08:05.039418614+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-11-28T17:08:05.731864519+00:00 stderr F + sudo -E kolla_set_configs 2025-11-28T17:08:05.742158339+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-28T17:08:05.801990404+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-28T17:08:05.802170049+00:00 stderr F INFO:__main__:Validating config file 2025-11-28T17:08:05.802197829+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-28T17:08:05.802248851+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-28T17:08:05.802335293+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-28T17:08:05.802885267+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-28T17:08:05.803573515+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-28T17:08:05.803827421+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-28T17:08:05.804065418+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-28T17:08:05.804302104+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-28T17:08:05.804519289+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-28T17:08:05.804642522+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-28T17:08:05.804775977+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-28T17:08:05.816190705+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-28T17:08:05.816233106+00:00 stderr F ++ cat /run_command 2025-11-28T17:08:05.816233106+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-28T17:08:05.816233106+00:00 stderr F + ARGS= 2025-11-28T17:08:05.816233106+00:00 stderr F + [[ ! -n '' ]] 2025-11-28T17:08:05.816233106+00:00 stderr F + . kolla_extend_start 2025-11-28T17:08:05.816233106+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-28T17:08:05.816233106+00:00 stderr F + umask 0022 2025-11-28T17:08:05.816233106+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-28T17:08:05.822576762+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-11-28T17:08:05.826140915+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-28T17:08:05.826140915+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-28T17:08:05.826140915+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-28T17:08:05.826140915+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-28T17:08:07.041095833+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-28T17:08:07.041426682+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-28T17:08:07.041468093+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-28T17:08:07.041508434+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-28T17:08:07.041551155+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-28T17:08:07.041592736+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-28T17:08:07.041634497+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-28T17:08:07.041836652+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-28T17:08:07.041836652+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-28T17:08:07.975231958+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-11-28T17:08:07.975425503+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x562ea2efe440 id: 33a8f23a-7495-4e9e-b059-bfbd8c4d0d53 2025-11-28T17:08:08.520416044+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-11-28T17:08:08.664230594+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-11-28T17:08:08.704803885+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-11-28T17:08:08.787631731+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-11-28T17:08:09.195452374+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-11-28T17:08:13.074823321+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-11-28T17:08:13.074823321+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 3.880s) 2025-11-28T17:08:13.153125029+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-11-28T17:08:13.229163187+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 76ms) 2025-11-28T17:08:13.318683618+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-11-28T17:08:13.390652619+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 71ms) 2025-11-28T17:08:13.433600133+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-11-28T17:08:14.332889017+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 899ms) 2025-11-28T17:08:14.413276258+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-11-28T17:08:14.746858561+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 333ms) 2025-11-28T18:11:38.543958353+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:933 2025-11-28T18:11:38.625391882+00:00 stderr F (log_finished) info: redis notify (call 933, PID 11401) exited with status 0 (execution time 82ms) 2025-11-28T18:11:38.668535342+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-11-28T18:11:38.751916283+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:935 2025-11-28T18:11:38.855797596+00:00 stderr F (log_finished) info: redis demote (call 935, PID 11447) exited with status 7 (execution time 104ms) 2025-11-28T18:11:38.900720465+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:936 2025-11-28T18:11:38.975905705+00:00 stderr F (log_finished) info: redis notify (call 936, PID 11509) exited with status 0 (execution time 75ms) 2025-11-28T18:11:39.084954197+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:937 2025-11-28T18:11:39.160986611+00:00 stderr F (log_finished) info: redis notify (call 937, PID 11555) exited with status 0 (execution time 76ms) 2025-11-28T18:11:39.203655259+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:938 2025-11-28T18:11:39.552619801+00:00 stderr F (log_finished) info: redis stop (call 938, PID 11601) exited with status 0 (execution time 348ms) 2025-11-28T18:11:39.778507984+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:944 2025-11-28T18:14:59.781973975+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11654] timed out after 3m20s 2025-11-28T18:14:59.781973975+00:00 stderr F (log_finished) info: redis start (call 944, PID 11654) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-11-28T18:14:59.828699312+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:952 2025-11-28T18:14:59.911207991+00:00 stderr F (log_finished) info: redis notify (call 952, PID 11922) exited with status 0 (execution time 82ms) 2025-11-28T18:15:00.019764838+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:953 2025-11-28T18:15:00.097786146+00:00 stderr F (log_finished) info: redis notify (call 953, PID 11968) exited with status 0 (execution time 78ms) 2025-11-28T18:15:00.143751733+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:954 2025-11-28T18:15:00.244143041+00:00 stderr F (log_finished) info: redis demote (call 954, PID 12014) exited with status 7 (execution time 100ms) 2025-11-28T18:15:00.292562173+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:955 2025-11-28T18:15:00.354078827+00:00 stderr F (log_finished) info: redis notify (call 955, PID 12076) exited with status 0 (execution time 60ms) 2025-11-28T18:15:00.463910840+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:956 2025-11-28T18:15:00.526336848+00:00 stderr F (log_finished) info: redis notify (call 956, PID 12122) exited with status 0 (execution time 62ms) 2025-11-28T18:15:00.570615189+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:957 2025-11-28T18:15:00.886494931+00:00 stderr F (log_finished) info: redis stop (call 957, PID 12168) exited with status 0 (execution time 316ms)