2025-10-13T07:29:48.658926935+00:00 stderr F + sudo -E kolla_set_configs 2025-10-13T07:29:48.678864684+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-10-13T07:29:48.736264397+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-13T07:29:48.736373520+00:00 stderr F INFO:__main__:Validating config file 2025-10-13T07:29:48.736431172+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-13T07:29:48.736431172+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-13T07:29:48.736552546+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-13T07:29:48.737176855+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-13T07:29:48.737834715+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-13T07:29:48.738467776+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-10-13T07:29:48.738722823+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-10-13T07:29:48.738983471+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-13T07:29:48.739224309+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-13T07:29:48.739432655+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-13T07:29:48.739663272+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-13T07:29:48.739801917+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-13T07:29:48.739905660+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-13T07:29:48.747298880+00:00 stderr F ++ cat /run_command 2025-10-13T07:29:48.748980161+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-13T07:29:48.748980161+00:00 stderr F + ARGS= 2025-10-13T07:29:48.749036933+00:00 stderr F + [[ ! -n '' ]] 2025-10-13T07:29:48.749036933+00:00 stderr F + . kolla_extend_start 2025-10-13T07:29:48.749177537+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-13T07:29:48.749185738+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-13T07:29:48.749195648+00:00 stderr F + umask 0022 2025-10-13T07:29:48.749224619+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-13T07:29:48.758846738+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-10-13T07:29:48.758906410+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-13T07:29:48.759024774+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-13T07:29:48.759079295+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-13T07:29:48.759443236+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-13T07:29:49.761808150+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-10-13T07:29:49.761808150+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-10-13T07:29:49.762289475+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-13T07:29:49.762708588+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-13T07:29:49.762708588+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-13T07:29:49.762708588+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-13T07:29:49.762708588+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-13T07:29:49.762800721+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-13T07:29:49.762851152+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-13T07:29:49.762910314+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-13T07:29:49.762910314+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-13T07:29:53.902045035+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-10-13T07:29:53.902356905+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-10-13T07:29:53.902383945+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-13T07:29:53.902603912+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-13T07:29:53.902671304+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-13T07:29:53.902707945+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-13T07:29:53.902797278+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-13T07:29:53.902839909+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-13T07:29:53.902881131+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-13T07:29:53.902920882+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-13T07:29:53.903008495+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-10-13T07:29:54.581768850+00:00 stderr F + sudo -E kolla_set_configs 2025-10-13T07:29:54.594467054+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Validating config file 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-13T07:29:54.671796336+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-13T07:29:54.679923058+00:00 stderr F ++ cat /run_command 2025-10-13T07:29:54.681838357+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-13T07:29:54.681838357+00:00 stderr F + ARGS= 2025-10-13T07:29:54.681866178+00:00 stderr F + [[ ! -n '' ]] 2025-10-13T07:29:54.681866178+00:00 stderr F + . kolla_extend_start 2025-10-13T07:29:54.682021623+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-13T07:29:54.682030233+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-13T07:29:54.682030233+00:00 stderr F + umask 0022 2025-10-13T07:29:54.682044934+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-13T07:29:54.690889618+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-10-13T07:29:54.691225509+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-13T07:29:54.691280481+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-13T07:29:54.691335093+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-13T07:29:54.691754016+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-13T07:29:55.970465549+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-13T07:29:55.970770899+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-13T07:29:55.970770899+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-13T07:29:55.971008196+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-13T07:29:55.971019886+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-13T07:29:55.971071048+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-13T07:29:55.971109629+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-13T07:29:55.971386609+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-13T07:29:55.971386609+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-13T07:29:56.826480239+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-10-13T07:29:56.826719966+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x563d0289fa90 id: 203309e9-2e69-4b98-89cd-45995521b626 2025-10-13T07:29:57.370173741+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-10-13T07:29:57.543774801+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-10-13T07:29:57.583996670+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-10-13T07:29:57.666116240+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-10-13T07:29:58.062332502+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-10-13T07:30:02.052081024+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-10-13T07:30:02.052081024+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 3.990s) 2025-10-13T07:30:02.130611483+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-10-13T07:30:02.200256355+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 69ms) 2025-10-13T07:30:02.306292298+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-10-13T07:30:02.366282600+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 59ms) 2025-10-13T07:30:02.409225404+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-10-13T07:30:03.300651683+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 892ms) 2025-10-13T07:30:03.380350687+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-10-13T07:30:03.710586161+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 330ms) 2025-10-13T08:34:29.580467171+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:947 2025-10-13T08:34:29.634107457+00:00 stderr F (log_finished) info: redis notify (call 947, PID 11576) exited with status 0 (execution time 53ms) 2025-10-13T08:34:29.676095402+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-10-13T08:34:29.758309676+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:949 2025-10-13T08:34:29.854040902+00:00 stderr F (log_finished) info: redis demote (call 949, PID 11622) exited with status 7 (execution time 96ms) 2025-10-13T08:34:29.900678280+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:950 2025-10-13T08:34:29.973425051+00:00 stderr F (log_finished) info: redis notify (call 950, PID 11684) exited with status 0 (execution time 72ms) 2025-10-13T08:34:30.078483216+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:951 2025-10-13T08:34:30.137816490+00:00 stderr F (log_finished) info: redis notify (call 951, PID 11730) exited with status 0 (execution time 59ms) 2025-10-13T08:34:30.180400913+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:952 2025-10-13T08:34:30.469596519+00:00 stderr F (log_finished) info: redis stop (call 952, PID 11776) exited with status 0 (execution time 289ms) 2025-10-13T08:34:30.683540997+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:958 2025-10-13T08:37:50.714467447+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11829] timed out after 3m20s 2025-10-13T08:37:50.714467447+00:00 stderr F (log_finished) info: redis start (call 958, PID 11829) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.030s) 2025-10-13T08:38:05.682770404+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:967 2025-10-13T08:38:05.768200408+00:00 stderr F (log_finished) info: redis notify (call 967, PID 12097) exited with status 0 (execution time 86ms) 2025-10-13T08:38:05.884238175+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:968 2025-10-13T08:38:05.951986940+00:00 stderr F (log_finished) info: redis notify (call 968, PID 12143) exited with status 0 (execution time 67ms) 2025-10-13T08:38:05.994543962+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:969 2025-10-13T08:38:06.092818205+00:00 stderr F (log_finished) info: redis demote (call 969, PID 12189) exited with status 7 (execution time 98ms) 2025-10-13T08:38:06.138547957+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:970 2025-10-13T08:38:06.216478298+00:00 stderr F (log_finished) info: redis notify (call 970, PID 12251) exited with status 0 (execution time 77ms) 2025-10-13T08:38:06.326905730+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:971 2025-10-13T08:38:06.405037928+00:00 stderr F (log_finished) info: redis notify (call 971, PID 12297) exited with status 0 (execution time 78ms) 2025-10-13T08:38:06.447380903+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:972 2025-10-13T08:38:06.785833151+00:00 stderr F (log_finished) info: redis stop (call 972, PID 12343) exited with status 0 (execution time 338ms)