2025-11-21T10:39:29.838664845+00:00 stderr F + sudo -E kolla_set_configs 2025-11-21T10:39:29.853463721+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-21T10:39:29.919760823+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-21T10:39:29.920907143+00:00 stderr F INFO:__main__:Validating config file 2025-11-21T10:39:29.920907143+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-21T10:39:29.920907143+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-21T10:39:29.920907143+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-21T10:39:29.920907143+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-21T10:39:29.921343394+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-21T10:39:29.921638962+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-21T10:39:29.921885189+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-21T10:39:29.922107085+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-21T10:39:29.922338761+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-21T10:39:29.922475614+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-21T10:39:29.922590197+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-21T10:39:29.929994540+00:00 stderr F ++ cat /run_command 2025-11-21T10:39:29.931644274+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-21T10:39:29.931667514+00:00 stderr F + ARGS= 2025-11-21T10:39:29.931712975+00:00 stderr F + [[ ! -n '' ]] 2025-11-21T10:39:29.931712975+00:00 stderr F + . kolla_extend_start 2025-11-21T10:39:29.931871689+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-21T10:39:29.931884510+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-21T10:39:29.931893920+00:00 stderr F + umask 0022 2025-11-21T10:39:29.931926321+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-21T10:39:29.941404029+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-11-21T10:39:29.941499291+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-21T10:39:29.941642465+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-21T10:39:29.941711627+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-21T10:39:29.942074146+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-21T10:39:30.278814222+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-11-21T10:39:30.278839153+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-11-21T10:39:30.279301885+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-21T10:39:30.279404307+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-21T10:39:30.279496210+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-21T10:39:30.279569072+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-21T10:39:30.279633563+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-21T10:39:30.279699535+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-21T10:39:30.279763747+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-21T10:39:30.279846459+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-21T10:39:30.279855669+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-21T10:39:34.743930238+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-11-21T10:39:34.743930238+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-11-21T10:39:34.743930238+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-21T10:39:34.744282107+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-21T10:39:34.744282107+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-21T10:39:34.744294368+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-21T10:39:34.744306498+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-21T10:39:34.744334759+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-21T10:39:34.744358709+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-21T10:39:34.744376220+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-21T10:39:34.744463862+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-11-21T10:39:35.381514692+00:00 stderr F + sudo -E kolla_set_configs 2025-11-21T10:39:35.394919453+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-21T10:39:35.447971429+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-21T10:39:35.448115192+00:00 stderr F INFO:__main__:Validating config file 2025-11-21T10:39:35.448127863+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-21T10:39:35.448161383+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-21T10:39:35.448244216+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-21T10:39:35.448716998+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-21T10:39:35.449217552+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-21T10:39:35.449411787+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-21T10:39:35.449654013+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-21T10:39:35.449817857+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-21T10:39:35.449998852+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-21T10:39:35.450077324+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-21T10:39:35.450182047+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-21T10:39:35.456365178+00:00 stderr F ++ cat /run_command 2025-11-21T10:39:35.458454903+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-21T10:39:35.458454903+00:00 stderr F + ARGS= 2025-11-21T10:39:35.458478233+00:00 stderr F + [[ ! -n '' ]] 2025-11-21T10:39:35.458488244+00:00 stderr F + . kolla_extend_start 2025-11-21T10:39:35.458599026+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-21T10:39:35.458607747+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-21T10:39:35.458607747+00:00 stderr F + umask 0022 2025-11-21T10:39:35.458607747+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-21T10:39:35.463731931+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-11-21T10:39:35.463731931+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-21T10:39:35.463731931+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-21T10:39:35.463731931+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-21T10:39:35.463980617+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-21T10:39:35.638480165+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-21T10:39:35.638480165+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-21T10:39:35.638480165+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-21T10:39:35.638480165+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-21T10:39:35.638480165+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-21T10:39:35.638480165+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-21T10:39:35.638480165+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-21T10:39:35.638508716+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-21T10:39:35.638508716+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-21T10:39:36.187132617+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-11-21T10:39:36.187346642+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x55c92fc1c780 id: 672ad451-4b36-42bc-afe3-d5727a726c86 2025-11-21T10:39:36.731219850+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-11-21T10:39:36.870795246+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-11-21T10:39:36.911735676+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-11-21T10:39:36.993712447+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-11-21T10:39:37.440939899+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-11-21T10:39:41.342915734+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-11-21T10:39:41.342915734+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 3.903s) 2025-11-21T10:39:41.422093573+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-11-21T10:39:41.489772181+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 67ms) 2025-11-21T10:39:41.576133987+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-11-21T10:39:41.642423988+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 66ms) 2025-11-21T10:39:41.685990507+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-11-21T10:39:42.600818534+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 915ms) 2025-11-21T10:39:42.681293716+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-11-21T10:39:43.004218951+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 323ms) 2025-11-21T11:42:06.066609833+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:919 2025-11-21T11:42:06.133276161+00:00 stderr F (log_finished) info: redis notify (call 919, PID 11227) exited with status 0 (execution time 66ms) 2025-11-21T11:42:06.174834320+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-11-21T11:42:06.259032775+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:921 2025-11-21T11:42:06.358903169+00:00 stderr F (log_finished) info: redis demote (call 921, PID 11273) exited with status 7 (execution time 99ms) 2025-11-21T11:42:06.408051579+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:922 2025-11-21T11:42:06.484427176+00:00 stderr F (log_finished) info: redis notify (call 922, PID 11335) exited with status 0 (execution time 76ms) 2025-11-21T11:42:06.594316137+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:923 2025-11-21T11:42:06.667523669+00:00 stderr F (log_finished) info: redis notify (call 923, PID 11381) exited with status 0 (execution time 73ms) 2025-11-21T11:42:06.710982578+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:924 2025-11-21T11:42:07.039549950+00:00 stderr F (log_finished) info: redis stop (call 924, PID 11427) exited with status 0 (execution time 328ms) 2025-11-21T11:42:07.239259526+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:930 2025-11-21T11:45:27.242897416+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11480] timed out after 3m20s 2025-11-21T11:45:27.242897416+00:00 stderr F (log_finished) info: redis start (call 930, PID 11480) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.004s) 2025-11-21T11:45:33.698229381+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:938 2025-11-21T11:45:33.799577434+00:00 stderr F (log_finished) info: redis notify (call 938, PID 11748) exited with status 0 (execution time 104ms) 2025-11-21T11:45:33.929414096+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:939 2025-11-21T11:45:34.010065377+00:00 stderr F (log_finished) info: redis notify (call 939, PID 11794) exited with status 0 (execution time 80ms) 2025-11-21T11:45:34.055285993+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:940 2025-11-21T11:45:34.165778980+00:00 stderr F (log_finished) info: redis demote (call 940, PID 11840) exited with status 7 (execution time 110ms) 2025-11-21T11:45:34.213307858+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:941 2025-11-21T11:45:34.300525564+00:00 stderr F (log_finished) info: redis notify (call 941, PID 11902) exited with status 0 (execution time 86ms) 2025-11-21T11:45:34.404335802+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:942 2025-11-21T11:45:34.488075135+00:00 stderr F (log_finished) info: redis notify (call 942, PID 11948) exited with status 0 (execution time 83ms) 2025-11-21T11:45:34.534144314+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:943 2025-11-21T11:45:34.831481823+00:00 stderr F (log_finished) info: redis stop (call 943, PID 11994) exited with status 0 (execution time 298ms)