2025-12-05T21:43:01.283951300+00:00 stderr F + sudo -E kolla_set_configs 2025-12-05T21:43:01.301545036+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-12-05T21:43:01.367527695+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-12-05T21:43:01.367527695+00:00 stderr F INFO:__main__:Validating config file 2025-12-05T21:43:01.367527695+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-12-05T21:43:01.367527695+00:00 stderr F INFO:__main__:Copying service configuration files 2025-12-05T21:43:01.367527695+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-12-05T21:43:01.367527695+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-12-05T21:43:01.367527695+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-12-05T21:43:01.367527695+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-12-05T21:43:01.367527695+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-12-05T21:43:01.368620738+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-12-05T21:43:01.368620738+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-12-05T21:43:01.368620738+00:00 stderr F INFO:__main__:Writing out command to execute 2025-12-05T21:43:01.368620738+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-12-05T21:43:01.368620738+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-12-05T21:43:01.368720041+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-12-05T21:43:01.376569210+00:00 stderr F ++ cat /run_command 2025-12-05T21:43:01.380628663+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-12-05T21:43:01.380651154+00:00 stderr F + ARGS= 2025-12-05T21:43:01.380687455+00:00 stderr F + [[ ! -n '' ]] 2025-12-05T21:43:01.380687455+00:00 stderr F + . kolla_extend_start 2025-12-05T21:43:01.380862180+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-12-05T21:43:01.380870700+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-12-05T21:43:01.380881351+00:00 stderr F + umask 0022 2025-12-05T21:43:01.380910962+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-12-05T21:43:01.386460920+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-12-05T21:43:01.386505032+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-12-05T21:43:01.386567664+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-12-05T21:43:01.386603685+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-12-05T21:43:01.386960657+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-12-05T21:43:01.594162545+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-12-05T21:43:01.594162545+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-12-05T21:43:01.594679470+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-12-05T21:43:01.594994620+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-12-05T21:43:01.595033391+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-12-05T21:43:01.595098043+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-12-05T21:43:01.595129324+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-12-05T21:43:01.595176555+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-12-05T21:43:01.595213706+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-12-05T21:43:01.595295799+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-12-05T21:43:01.595295799+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-12-05T21:43:06.244311364+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-12-05T21:43:06.244342675+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-12-05T21:43:06.244342675+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T21:43:06.244938183+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T21:43:06.245050737+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T21:43:06.245050737+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T21:43:06.245116489+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T21:43:06.245188791+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T21:43:06.245240373+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T21:43:06.245275094+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T21:43:06.245387297+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-12-05T21:43:06.986090617+00:00 stderr F + sudo -E kolla_set_configs 2025-12-05T21:43:06.998358261+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-12-05T21:43:07.050528748+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-12-05T21:43:07.050528748+00:00 stderr F INFO:__main__:Validating config file 2025-12-05T21:43:07.050528748+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-12-05T21:43:07.050528748+00:00 stderr F INFO:__main__:Copying service configuration files 2025-12-05T21:43:07.050528748+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-12-05T21:43:07.050528748+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-12-05T21:43:07.051034154+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-12-05T21:43:07.051524259+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-12-05T21:43:07.051752456+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-12-05T21:43:07.052070766+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-12-05T21:43:07.052253911+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-12-05T21:43:07.052577271+00:00 stderr F INFO:__main__:Writing out command to execute 2025-12-05T21:43:07.052647283+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-12-05T21:43:07.052734576+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-12-05T21:43:07.052839139+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-12-05T21:43:07.058924924+00:00 stderr F ++ cat /run_command 2025-12-05T21:43:07.061085340+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-12-05T21:43:07.061095470+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-12-05T21:43:07.061095470+00:00 stderr F + ARGS= 2025-12-05T21:43:07.061095470+00:00 stderr F + [[ ! -n '' ]] 2025-12-05T21:43:07.061095470+00:00 stderr F + . kolla_extend_start 2025-12-05T21:43:07.061095470+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-12-05T21:43:07.061095470+00:00 stderr F + umask 0022 2025-12-05T21:43:07.061095470+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-12-05T21:43:07.066340910+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-12-05T21:43:07.068523597+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-12-05T21:43:07.068523597+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-12-05T21:43:07.068523597+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-12-05T21:43:07.068523597+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-12-05T21:43:07.212726866+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-12-05T21:43:07.212803889+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-12-05T21:43:07.212818019+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-12-05T21:43:07.212883451+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-12-05T21:43:07.212896962+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-12-05T21:43:07.212949443+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-12-05T21:43:07.212987994+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-12-05T21:43:07.213062367+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-12-05T21:43:07.213062367+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-12-05T21:43:07.773109817+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-12-05T21:43:07.773450917+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x5625420481b0 id: a098a540-3683-462b-9c16-b735693cf26c 2025-12-05T21:43:08.318561153+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-12-05T21:43:08.476813100+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-12-05T21:43:08.517745957+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-12-05T21:43:08.599760143+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-12-05T21:43:08.981103733+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-12-05T21:43:12.965068312+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-12-05T21:43:12.965068312+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 3.984s) 2025-12-05T21:43:13.042252562+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-12-05T21:43:13.111193761+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 68ms) 2025-12-05T21:43:13.235231857+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-12-05T21:43:13.306344631+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 71ms) 2025-12-05T21:43:13.349607249+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-12-05T21:43:14.259997215+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 911ms) 2025-12-05T21:43:14.340051492+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-12-05T21:43:14.666909393+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 326ms) 2025-12-05T22:45:38.322877186+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:919 2025-12-05T22:45:38.393701660+00:00 stderr F (log_finished) info: redis notify (call 919, PID 11225) exited with status 0 (execution time 72ms) 2025-12-05T22:45:38.435870521+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-12-05T22:45:38.518043907+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:921 2025-12-05T22:45:38.613951526+00:00 stderr F (log_finished) info: redis demote (call 921, PID 11271) exited with status 7 (execution time 95ms) 2025-12-05T22:45:38.660042707+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:922 2025-12-05T22:45:38.731227984+00:00 stderr F (log_finished) info: redis notify (call 922, PID 11333) exited with status 0 (execution time 72ms) 2025-12-05T22:45:38.841153935+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:923 2025-12-05T22:45:38.915835840+00:00 stderr F (log_finished) info: redis notify (call 923, PID 11379) exited with status 0 (execution time 74ms) 2025-12-05T22:45:38.958050852+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:924 2025-12-05T22:45:39.289701653+00:00 stderr F (log_finished) info: redis stop (call 924, PID 11425) exited with status 0 (execution time 331ms) 2025-12-05T22:45:39.501105576+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:930 2025-12-05T22:48:59.505053348+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11478] timed out after 3m20s 2025-12-05T22:48:59.505053348+00:00 stderr F (log_finished) info: redis start (call 930, PID 11478) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.003s) 2025-12-05T22:49:05.908626096+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:938 2025-12-05T22:49:05.989613605+00:00 stderr F (log_finished) info: redis notify (call 938, PID 11747) exited with status 0 (execution time 81ms) 2025-12-05T22:49:06.111093842+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:939 2025-12-05T22:49:06.187854341+00:00 stderr F (log_finished) info: redis notify (call 939, PID 11793) exited with status 0 (execution time 76ms) 2025-12-05T22:49:06.229945080+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:940 2025-12-05T22:49:06.321091251+00:00 stderr F (log_finished) info: redis demote (call 940, PID 11839) exited with status 7 (execution time 91ms) 2025-12-05T22:49:06.369808605+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:941 2025-12-05T22:49:06.441075243+00:00 stderr F (log_finished) info: redis notify (call 941, PID 11901) exited with status 0 (execution time 71ms) 2025-12-05T22:49:06.542074769+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:942 2025-12-05T22:49:06.626091231+00:00 stderr F (log_finished) info: redis notify (call 942, PID 11947) exited with status 0 (execution time 84ms) 2025-12-05T22:49:06.671174272+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:943 2025-12-05T22:49:07.000538453+00:00 stderr F (log_finished) info: redis stop (call 943, PID 11993) exited with status 0 (execution time 330ms)