2025-12-01T15:38:50.884327429+00:00 stderr F + sudo -E kolla_set_configs 2025-12-01T15:38:50.898719828+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-12-01T15:38:50.962432488+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-12-01T15:38:50.962432488+00:00 stderr F INFO:__main__:Validating config file 2025-12-01T15:38:50.962432488+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-12-01T15:38:50.962432488+00:00 stderr F INFO:__main__:Copying service configuration files 2025-12-01T15:38:50.962432488+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-12-01T15:38:50.963497623+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-12-01T15:38:50.963497623+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-12-01T15:38:50.963819513+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-12-01T15:38:50.964039840+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-12-01T15:38:50.964258597+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-12-01T15:38:50.964517685+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-12-01T15:38:50.964743062+00:00 stderr F INFO:__main__:Writing out command to execute 2025-12-01T15:38:50.965012090+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-12-01T15:38:50.965125074+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-12-01T15:38:50.965236137+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-12-01T15:38:50.972750937+00:00 stderr F ++ cat /run_command 2025-12-01T15:38:50.974828084+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-12-01T15:38:50.974855515+00:00 stderr F + ARGS= 2025-12-01T15:38:50.974866895+00:00 stderr F + [[ ! -n '' ]] 2025-12-01T15:38:50.974877585+00:00 stderr F + . kolla_extend_start 2025-12-01T15:38:50.974987639+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-12-01T15:38:50.974997599+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-12-01T15:38:50.974997599+00:00 stderr F + umask 0022 2025-12-01T15:38:50.974997599+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-12-01T15:38:50.989785480+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-12-01T15:38:50.989852752+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-12-01T15:38:50.989968106+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-12-01T15:38:50.990036938+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-12-01T15:38:50.990964107+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-12-01T15:38:51.107910703+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-12-01T15:38:51.107944674+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-12-01T15:38:51.108419059+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-12-01T15:38:51.108611295+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-12-01T15:38:51.108668947+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-12-01T15:38:51.108712139+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-12-01T15:38:51.108756010+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-12-01T15:38:51.108800171+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-12-01T15:38:51.108847093+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-12-01T15:38:51.108947936+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-12-01T15:38:51.108984368+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-12-01T15:38:55.810644123+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-12-01T15:38:55.810644123+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-12-01T15:38:55.810644123+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-01T15:38:55.811083593+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-01T15:38:55.811113644+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-01T15:38:55.811137774+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-01T15:38:55.811220186+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-01T15:38:55.811220186+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-01T15:38:55.811220186+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-01T15:38:55.811220186+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-01T15:38:55.811283278+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-12-01T15:38:56.346925745+00:00 stderr F + sudo -E kolla_set_configs 2025-12-01T15:38:56.355078054+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-12-01T15:38:56.415035054+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-12-01T15:38:56.415247469+00:00 stderr F INFO:__main__:Validating config file 2025-12-01T15:38:56.415247469+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-12-01T15:38:56.415280399+00:00 stderr F INFO:__main__:Copying service configuration files 2025-12-01T15:38:56.415399602+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-12-01T15:38:56.415969035+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-12-01T15:38:56.417898290+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-12-01T15:38:56.417898290+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-12-01T15:38:56.417898290+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-12-01T15:38:56.417898290+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-12-01T15:38:56.418086964+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-12-01T15:38:56.418297709+00:00 stderr F INFO:__main__:Writing out command to execute 2025-12-01T15:38:56.418551255+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-12-01T15:38:56.418685748+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-12-01T15:38:56.418809901+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-12-01T15:38:56.425336842+00:00 stderr F ++ cat /run_command 2025-12-01T15:38:56.426765955+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-12-01T15:38:56.426780526+00:00 stderr F + ARGS= 2025-12-01T15:38:56.426811606+00:00 stderr F + [[ ! -n '' ]] 2025-12-01T15:38:56.426811606+00:00 stderr F + . kolla_extend_start 2025-12-01T15:38:56.426902539+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-12-01T15:38:56.426909639+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-12-01T15:38:56.426916139+00:00 stderr F + umask 0022 2025-12-01T15:38:56.426932439+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-12-01T15:38:56.432744514+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-12-01T15:38:56.432960899+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-12-01T15:38:56.433017520+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-12-01T15:38:56.433051741+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-12-01T15:38:56.433524132+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-12-01T15:38:57.011240474+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-12-01T15:38:57.011240474+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-12-01T15:38:57.011240474+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-12-01T15:38:57.011240474+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-12-01T15:38:57.011240474+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-12-01T15:38:57.011240474+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-12-01T15:38:57.011240474+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-12-01T15:38:57.011240474+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-12-01T15:38:57.011240474+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-12-01T15:38:57.011240474+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-12-01T15:38:57.014466850+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x55a5b61662d0 id: a5d5ac5d-d4ad-46b6-9954-fb12b2e815d0 2025-12-01T15:38:57.554719024+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-12-01T15:38:57.698357462+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-12-01T15:38:57.738749327+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-12-01T15:38:57.820819288+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-12-01T15:38:58.150841573+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-12-01T15:39:02.075766933+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-12-01T15:39:02.075766933+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 3.925s) 2025-12-01T15:39:02.153266088+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-12-01T15:39:02.228302417+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 75ms) 2025-12-01T15:39:02.329068081+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-12-01T15:39:02.430667534+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 101ms) 2025-12-01T15:39:02.474114620+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-12-01T15:39:03.385899532+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 912ms) 2025-12-01T15:39:03.466218013+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-12-01T15:39:03.797494737+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 332ms) 2025-12-01T16:41:06.713928965+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:915 2025-12-01T16:41:06.785904379+00:00 stderr F (log_finished) info: redis notify (call 915, PID 11167) exited with status 0 (execution time 73ms) 2025-12-01T16:41:06.828329856+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-12-01T16:41:06.911080592+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:917 2025-12-01T16:41:07.005995873+00:00 stderr F (log_finished) info: redis demote (call 917, PID 11213) exited with status 7 (execution time 94ms) 2025-12-01T16:41:07.052265716+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:918 2025-12-01T16:41:07.121565889+00:00 stderr F (log_finished) info: redis notify (call 918, PID 11275) exited with status 0 (execution time 69ms) 2025-12-01T16:41:07.199453506+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:919 2025-12-01T16:41:07.275076203+00:00 stderr F (log_finished) info: redis notify (call 919, PID 11321) exited with status 0 (execution time 75ms) 2025-12-01T16:41:07.317970333+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:920 2025-12-01T16:41:07.635965229+00:00 stderr F (log_finished) info: redis stop (call 920, PID 11367) exited with status 0 (execution time 317ms) 2025-12-01T16:41:07.849145000+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:926 2025-12-01T16:44:27.851173395+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11420] timed out after 3m20s 2025-12-01T16:44:27.851173395+00:00 stderr F (log_finished) info: redis start (call 926, PID 11420) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-12-01T16:44:40.833291782+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:934 2025-12-01T16:44:40.908254479+00:00 stderr F (log_finished) info: redis notify (call 934, PID 11689) exited with status 0 (execution time 76ms) 2025-12-01T16:44:41.024350672+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:935 2025-12-01T16:44:41.113549157+00:00 stderr F (log_finished) info: redis notify (call 935, PID 11735) exited with status 0 (execution time 89ms) 2025-12-01T16:44:41.157132678+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:936 2025-12-01T16:44:41.256872607+00:00 stderr F (log_finished) info: redis demote (call 936, PID 11781) exited with status 7 (execution time 99ms) 2025-12-01T16:44:41.304021368+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:937 2025-12-01T16:44:41.375970313+00:00 stderr F (log_finished) info: redis notify (call 937, PID 11843) exited with status 0 (execution time 71ms) 2025-12-01T16:44:41.479064795+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:938 2025-12-01T16:44:41.552813585+00:00 stderr F (log_finished) info: redis notify (call 938, PID 11889) exited with status 0 (execution time 73ms) 2025-12-01T16:44:41.596898691+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:939 2025-12-01T16:44:41.908968125+00:00 stderr F (log_finished) info: redis stop (call 939, PID 11935) exited with status 0 (execution time 312ms)