2025-10-08T07:36:07.326640369+00:00 stderr F + sudo -E kolla_set_configs 2025-10-08T07:36:07.342124711+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-10-08T07:36:07.376909696+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-08T07:36:07.377099521+00:00 stderr F INFO:__main__:Validating config file 2025-10-08T07:36:07.377131982+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-08T07:36:07.377150253+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-08T07:36:07.377250026+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-08T07:36:07.377795983+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-08T07:36:07.378372591+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-08T07:36:07.378661750+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-10-08T07:36:07.378825345+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-10-08T07:36:07.379021581+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-08T07:36:07.379232117+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-08T07:36:07.379424793+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-08T07:36:07.379607259+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-08T07:36:07.379689651+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-08T07:36:07.379771385+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-08T07:36:07.386958208+00:00 stderr F ++ cat /run_command 2025-10-08T07:36:07.388823107+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-08T07:36:07.388875488+00:00 stderr F + ARGS= 2025-10-08T07:36:07.388927550+00:00 stderr F + [[ ! -n '' ]] 2025-10-08T07:36:07.388934320+00:00 stderr F + . kolla_extend_start 2025-10-08T07:36:07.389163227+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-08T07:36:07.389181278+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-08T07:36:07.389222979+00:00 stderr F + umask 0022 2025-10-08T07:36:07.389249920+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-08T07:36:07.405122295+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-10-08T07:36:07.405170746+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-08T07:36:07.405303510+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-08T07:36:07.405372653+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-08T07:36:07.406019122+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-08T07:36:07.576883648+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-10-08T07:36:07.576883648+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-10-08T07:36:07.577254500+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-08T07:36:07.577478457+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-08T07:36:07.577522578+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-08T07:36:07.577565749+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-08T07:36:07.577628621+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-08T07:36:07.577663352+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-08T07:36:07.577706494+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-08T07:36:07.577867179+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-08T07:36:07.577867179+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-08T07:36:12.612344902+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-10-08T07:36:12.612344902+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-10-08T07:36:12.612344902+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T07:36:12.612829668+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T07:36:12.612863379+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T07:36:12.613769657+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T07:36:12.613769657+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T07:36:12.613769657+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T07:36:12.613769657+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T07:36:12.613769657+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-08T07:36:12.613769657+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-10-08T07:36:13.488831432+00:00 stderr F + sudo -E kolla_set_configs 2025-10-08T07:36:13.512442078+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-10-08T07:36:13.571175049+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-08T07:36:13.571451057+00:00 stderr F INFO:__main__:Validating config file 2025-10-08T07:36:13.571472408+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-08T07:36:13.571514789+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-08T07:36:13.571632503+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-08T07:36:13.572237302+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-08T07:36:13.573040876+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-08T07:36:13.573493860+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-10-08T07:36:13.573730609+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-10-08T07:36:13.574000167+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-08T07:36:13.574245944+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-08T07:36:13.574501682+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-08T07:36:13.574753650+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-08T07:36:13.574877034+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-08T07:36:13.575029599+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-08T07:36:13.582535943+00:00 stderr F ++ cat /run_command 2025-10-08T07:36:13.585649050+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-08T07:36:13.585668290+00:00 stderr F + ARGS= 2025-10-08T07:36:13.585706802+00:00 stderr F + [[ ! -n '' ]] 2025-10-08T07:36:13.585706802+00:00 stderr F + . kolla_extend_start 2025-10-08T07:36:13.585841786+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-08T07:36:13.585849226+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-08T07:36:13.585849226+00:00 stderr F + umask 0022 2025-10-08T07:36:13.585870107+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-08T07:36:13.592534964+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-10-08T07:36:13.592778871+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-08T07:36:13.592840313+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-08T07:36:13.592887235+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-08T07:36:13.593347730+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-08T07:36:13.729050939+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-08T07:36:13.729271186+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-08T07:36:13.729345698+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-08T07:36:13.729424441+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-08T07:36:13.729479453+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-08T07:36:13.729546065+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-08T07:36:13.729602656+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-08T07:36:13.729683589+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-08T07:36:13.729683589+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-08T07:36:14.268287757+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-10-08T07:36:14.268611638+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x55b322a69890 id: 607f4adf-0ff8-4d86-bbba-170683d6a150 2025-10-08T07:36:14.811953424+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-10-08T07:36:14.974826950+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-10-08T07:36:15.016691095+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-10-08T07:36:15.099742823+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-10-08T07:36:15.514224943+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-10-08T07:36:19.515075699+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-10-08T07:36:19.515075699+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 4s) 2025-10-08T07:36:19.593340868+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-10-08T07:36:19.664878299+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 71ms) 2025-10-08T07:36:19.757687941+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-10-08T07:36:19.831233534+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 74ms) 2025-10-08T07:36:19.874184633+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-10-08T07:36:20.788350107+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 915ms) 2025-10-08T07:36:20.868221126+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-10-08T07:36:21.200173394+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 331ms) 2025-10-08T08:40:46.587758521+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:947 2025-10-08T08:40:46.649878903+00:00 stderr F (log_finished) info: redis notify (call 947, PID 11576) exited with status 0 (execution time 62ms) 2025-10-08T08:40:46.691693841+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-10-08T08:40:46.774900003+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:949 2025-10-08T08:40:46.854136901+00:00 stderr F (log_finished) info: redis demote (call 949, PID 11622) exited with status 7 (execution time 79ms) 2025-10-08T08:40:46.900985856+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:950 2025-10-08T08:40:46.979667506+00:00 stderr F (log_finished) info: redis notify (call 950, PID 11684) exited with status 0 (execution time 78ms) 2025-10-08T08:40:47.066243254+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:951 2025-10-08T08:40:47.147777623+00:00 stderr F (log_finished) info: redis notify (call 951, PID 11730) exited with status 0 (execution time 81ms) 2025-10-08T08:40:47.191089267+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:952 2025-10-08T08:40:47.506313085+00:00 stderr F (log_finished) info: redis stop (call 952, PID 11776) exited with status 0 (execution time 315ms) 2025-10-08T08:40:47.728130751+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:958 2025-10-08T08:44:07.732004064+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11829] timed out after 3m20s 2025-10-08T08:44:07.732004064+00:00 stderr F (log_finished) info: redis start (call 958, PID 11829) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-10-08T08:44:20.696716088+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:966 2025-10-08T08:44:20.781950364+00:00 stderr F (log_finished) info: redis notify (call 966, PID 12097) exited with status 0 (execution time 86ms) 2025-10-08T08:44:20.910235815+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:967 2025-10-08T08:44:20.993714755+00:00 stderr F (log_finished) info: redis notify (call 967, PID 12143) exited with status 0 (execution time 84ms) 2025-10-08T08:44:21.039087245+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:968 2025-10-08T08:44:21.168570504+00:00 stderr F (log_finished) info: redis demote (call 968, PID 12189) exited with status 7 (execution time 129ms) 2025-10-08T08:44:21.214025605+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:969 2025-10-08T08:44:21.285933454+00:00 stderr F (log_finished) info: redis notify (call 969, PID 12251) exited with status 0 (execution time 71ms) 2025-10-08T08:44:21.367060471+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:970 2025-10-08T08:44:21.446481504+00:00 stderr F (log_finished) info: redis notify (call 970, PID 12297) exited with status 0 (execution time 79ms) 2025-10-08T08:44:21.488994573+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:971 2025-10-08T08:44:21.829828371+00:00 stderr F (log_finished) info: redis stop (call 971, PID 12343) exited with status 0 (execution time 341ms)