2025-12-05T17:18:58.674072233+00:00 stderr F + sudo -E kolla_set_configs 2025-12-05T17:18:58.687509782+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-12-05T17:18:58.748120950+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-12-05T17:18:58.748350126+00:00 stderr F INFO:__main__:Validating config file 2025-12-05T17:18:58.748372686+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-12-05T17:18:58.748405987+00:00 stderr F INFO:__main__:Copying service configuration files 2025-12-05T17:18:58.748545041+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-12-05T17:18:58.749127486+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-12-05T17:18:58.749848205+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-12-05T17:18:58.750241916+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-12-05T17:18:58.750464642+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-12-05T17:18:58.750708479+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-12-05T17:18:58.750970936+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-12-05T17:18:58.751180611+00:00 stderr F INFO:__main__:Writing out command to execute 2025-12-05T17:18:58.751420637+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-12-05T17:18:58.751577952+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-12-05T17:18:58.751675404+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-12-05T17:18:58.759216996+00:00 stderr F ++ cat /run_command 2025-12-05T17:18:58.761285420+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-12-05T17:18:58.761285420+00:00 stderr F + ARGS= 2025-12-05T17:18:58.761354062+00:00 stderr F + [[ ! -n '' ]] 2025-12-05T17:18:58.761354062+00:00 stderr F + . kolla_extend_start 2025-12-05T17:18:58.761539628+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-12-05T17:18:58.761550938+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-12-05T17:18:58.761550938+00:00 stderr F + umask 0022 2025-12-05T17:18:58.761595059+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-12-05T17:18:58.771607806+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-12-05T17:18:58.771666567+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-12-05T17:18:58.771786251+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-12-05T17:18:58.771865513+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-12-05T17:18:58.772314185+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-12-05T17:18:59.189347493+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-12-05T17:18:59.189347493+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-12-05T17:18:59.189914818+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-12-05T17:18:59.190168486+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-12-05T17:18:59.190201336+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-12-05T17:18:59.190265028+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-12-05T17:18:59.190305309+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-12-05T17:18:59.190353490+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-12-05T17:18:59.190402682+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-12-05T17:18:59.190467703+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-12-05T17:18:59.190467703+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-12-05T17:19:03.770507529+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-12-05T17:19:03.770507529+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-12-05T17:19:03.770507529+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T17:19:03.771060964+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T17:19:03.771110335+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T17:19:03.771142386+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T17:19:03.771196628+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T17:19:03.771230448+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T17:19:03.771272620+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T17:19:03.771314761+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-05T17:19:03.771400603+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-12-05T17:19:04.522740032+00:00 stderr F + sudo -E kolla_set_configs 2025-12-05T17:19:04.541524873+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-12-05T17:19:04.616550145+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-12-05T17:19:04.616550145+00:00 stderr F INFO:__main__:Validating config file 2025-12-05T17:19:04.616550145+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-12-05T17:19:04.616550145+00:00 stderr F INFO:__main__:Copying service configuration files 2025-12-05T17:19:04.616708880+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-12-05T17:19:04.617599953+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-12-05T17:19:04.618679582+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-12-05T17:19:04.619281498+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-12-05T17:19:04.619708780+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-12-05T17:19:04.620063469+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-12-05T17:19:04.620321676+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-12-05T17:19:04.620560022+00:00 stderr F INFO:__main__:Writing out command to execute 2025-12-05T17:19:04.620803468+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-12-05T17:19:04.620926672+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-12-05T17:19:04.621068785+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-12-05T17:19:04.634944376+00:00 stderr F ++ cat /run_command 2025-12-05T17:19:04.636816636+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-12-05T17:19:04.636828976+00:00 stderr F + ARGS= 2025-12-05T17:19:04.636865497+00:00 stderr F + [[ ! -n '' ]] 2025-12-05T17:19:04.636865497+00:00 stderr F + . kolla_extend_start 2025-12-05T17:19:04.636956540+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-12-05T17:19:04.636962540+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-12-05T17:19:04.636962540+00:00 stderr F + umask 0022 2025-12-05T17:19:04.636969900+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-12-05T17:19:04.642276832+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-12-05T17:19:04.642475177+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-12-05T17:19:04.642524968+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-12-05T17:19:04.642557229+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-12-05T17:19:04.642905528+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-12-05T17:19:04.693382045+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-12-05T17:19:04.693472358+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-12-05T17:19:04.693472358+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-12-05T17:19:04.693505768+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-12-05T17:19:04.693553320+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-12-05T17:19:04.693635692+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-12-05T17:19:04.693677843+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-12-05T17:19:04.693733144+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-12-05T17:19:04.693733144+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-12-05T17:19:05.304878652+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-12-05T17:19:05.304940734+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x55ecf31ca360 id: 30f5b42a-7bd3-49f7-b3ac-95d74c0497ea 2025-12-05T17:19:05.848921160+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-12-05T17:19:06.022781510+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-12-05T17:19:06.063692841+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-12-05T17:19:06.146886411+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-12-05T17:19:06.577091170+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-12-05T17:19:11.340701966+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-12-05T17:19:11.340701966+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 4.763s) 2025-12-05T17:19:11.417065533+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-12-05T17:19:11.499960756+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 82ms) 2025-12-05T17:19:11.621290823+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-12-05T17:19:11.705103450+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 83ms) 2025-12-05T17:19:11.749131275+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-12-05T17:19:12.671219180+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 923ms) 2025-12-05T17:19:12.751179023+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-12-05T17:19:13.091819843+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 341ms) 2025-12-05T18:22:37.241345319+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:933 2025-12-05T18:22:37.302615966+00:00 stderr F (log_finished) info: redis notify (call 933, PID 11400) exited with status 0 (execution time 62ms) 2025-12-05T18:22:37.344938946+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-12-05T18:22:37.428123437+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:935 2025-12-05T18:22:37.520322805+00:00 stderr F (log_finished) info: redis demote (call 935, PID 11446) exited with status 7 (execution time 92ms) 2025-12-05T18:22:37.566148566+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:936 2025-12-05T18:22:37.622081063+00:00 stderr F (log_finished) info: redis notify (call 936, PID 11508) exited with status 0 (execution time 55ms) 2025-12-05T18:22:37.705243874+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:937 2025-12-05T18:22:37.777115738+00:00 stderr F (log_finished) info: redis notify (call 937, PID 11554) exited with status 0 (execution time 71ms) 2025-12-05T18:22:37.819881800+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:938 2025-12-05T18:22:38.119129376+00:00 stderr F (log_finished) info: redis stop (call 938, PID 11600) exited with status 0 (execution time 300ms) 2025-12-05T18:22:38.333049876+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:944 2025-12-05T18:25:58.336066609+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11653] timed out after 3m20s 2025-12-05T18:25:58.336066609+00:00 stderr F (log_finished) info: redis start (call 944, PID 11653) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.003s) 2025-12-05T18:26:01.506153643+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:952 2025-12-05T18:26:01.587219919+00:00 stderr F (log_finished) info: redis notify (call 952, PID 11921) exited with status 0 (execution time 82ms) 2025-12-05T18:26:01.710951163+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:953 2025-12-05T18:26:01.784376478+00:00 stderr F (log_finished) info: redis notify (call 953, PID 11967) exited with status 0 (execution time 73ms) 2025-12-05T18:26:01.828060234+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:954 2025-12-05T18:26:01.911177983+00:00 stderr F (log_finished) info: redis demote (call 954, PID 12013) exited with status 7 (execution time 84ms) 2025-12-05T18:26:01.961137543+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:955 2025-12-05T18:26:02.021816825+00:00 stderr F (log_finished) info: redis notify (call 955, PID 12075) exited with status 0 (execution time 60ms) 2025-12-05T18:26:02.112167133+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:956 2025-12-05T18:26:02.181708867+00:00 stderr F (log_finished) info: redis notify (call 956, PID 12121) exited with status 0 (execution time 69ms) 2025-12-05T18:26:02.226045580+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:957 2025-12-05T18:26:02.521860596+00:00 stderr F (log_finished) info: redis stop (call 957, PID 12167) exited with status 0 (execution time 295ms)