2025-09-29T20:03:27.116131522+00:00 stderr F + sudo -E kolla_set_configs 2025-09-29T20:03:27.131129136+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-09-29T20:03:27.200616914+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-09-29T20:03:27.200861341+00:00 stderr F INFO:__main__:Validating config file 2025-09-29T20:03:27.200936813+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-09-29T20:03:27.200973624+00:00 stderr F INFO:__main__:Copying service configuration files 2025-09-29T20:03:27.201135369+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-09-29T20:03:27.201923054+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-09-29T20:03:27.202919085+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-09-29T20:03:27.203269276+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-09-29T20:03:27.204580656+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-09-29T20:03:27.204580656+00:00 stderr F INFO:__main__:Writing out command to execute 2025-09-29T20:03:27.204580656+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-09-29T20:03:27.204580656+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-09-29T20:03:27.204580656+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-09-29T20:03:27.211793719+00:00 stderr F ++ cat /run_command 2025-09-29T20:03:27.213631415+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-09-29T20:03:27.213654916+00:00 stderr F + ARGS= 2025-09-29T20:03:27.213704737+00:00 stderr F + [[ ! -n '' ]] 2025-09-29T20:03:27.213704737+00:00 stderr F + . kolla_extend_start 2025-09-29T20:03:27.213859313+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-09-29T20:03:27.213872204+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-09-29T20:03:27.213882174+00:00 stderr F + umask 0022 2025-09-29T20:03:27.213915625+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-09-29T20:03:27.223734768+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-09-29T20:03:27.223800310+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-09-29T20:03:27.223906363+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-09-29T20:03:27.223974595+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-09-29T20:03:27.224585994+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-09-29T20:03:27.514234398+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-09-29T20:03:27.514387882+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-09-29T20:03:27.514997051+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-09-29T20:03:27.515295780+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-09-29T20:03:27.515341362+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-09-29T20:03:27.515390013+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-09-29T20:03:27.515435664+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-09-29T20:03:27.515492876+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-09-29T20:03:27.515583329+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-09-29T20:03:27.515655141+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-09-29T20:03:27.515655141+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-09-29T20:03:32.064764338+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-09-29T20:03:32.064764338+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-09-29T20:03:32.064764338+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-09-29T20:03:32.065063147+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-09-29T20:03:32.065063147+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-09-29T20:03:32.065063147+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-09-29T20:03:32.065063147+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-09-29T20:03:32.065063147+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-09-29T20:03:32.065063147+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-09-29T20:03:32.065063147+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-09-29T20:03:32.065063147+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-09-29T20:03:32.682038828+00:00 stderr F + sudo -E kolla_set_configs 2025-09-29T20:03:32.691835941+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-09-29T20:03:32.741110315+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-09-29T20:03:32.741312081+00:00 stderr F INFO:__main__:Validating config file 2025-09-29T20:03:32.741364992+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-09-29T20:03:32.741385503+00:00 stderr F INFO:__main__:Copying service configuration files 2025-09-29T20:03:32.741519647+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-09-29T20:03:32.742347052+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-09-29T20:03:32.743046714+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-09-29T20:03:32.743313992+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-09-29T20:03:32.743604941+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-09-29T20:03:32.743836069+00:00 stderr F INFO:__main__:Writing out command to execute 2025-09-29T20:03:32.744099717+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-09-29T20:03:32.744228121+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-09-29T20:03:32.744382016+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-09-29T20:03:32.752372753+00:00 stderr F ++ cat /run_command 2025-09-29T20:03:32.755588052+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-09-29T20:03:32.755608432+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-09-29T20:03:32.755608432+00:00 stderr F + ARGS= 2025-09-29T20:03:32.755608432+00:00 stderr F + [[ ! -n '' ]] 2025-09-29T20:03:32.755608432+00:00 stderr F + . kolla_extend_start 2025-09-29T20:03:32.755608432+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-09-29T20:03:32.755608432+00:00 stderr F + umask 0022 2025-09-29T20:03:32.755608432+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-09-29T20:03:32.764121276+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-09-29T20:03:32.764121276+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-09-29T20:03:32.764121276+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-09-29T20:03:32.764121276+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-09-29T20:03:32.765245920+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-09-29T20:03:32.911617564+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-09-29T20:03:32.911875403+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-09-29T20:03:32.911888643+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-09-29T20:03:32.911940465+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-09-29T20:03:32.911989787+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-09-29T20:03:32.912023038+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-09-29T20:03:32.912060139+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-09-29T20:03:32.912238044+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-09-29T20:03:32.912238044+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-09-29T20:03:33.468995863+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-09-29T20:03:33.469188309+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x55a5b5654d60 id: 2fd018b4-2cd8-43a6-873f-25be0fad6ae2 2025-09-29T20:03:34.011903605+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-09-29T20:03:34.151989185+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-09-29T20:03:34.193255501+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-09-29T20:03:34.275144892+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-09-29T20:03:34.680144921+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-09-29T20:03:38.598756959+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-09-29T20:03:38.598756959+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 3.919s) 2025-09-29T20:03:38.677168372+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-09-29T20:03:38.743231584+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 66ms) 2025-09-29T20:03:38.836279910+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-09-29T20:03:38.904646644+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 69ms) 2025-09-29T20:03:38.947236410+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-09-29T20:03:39.852554114+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 905ms) 2025-09-29T20:03:39.933470615+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-09-29T20:03:40.253979872+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 320ms) 2025-09-29T21:08:03.845074829+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:947 2025-09-29T21:08:03.915194723+00:00 stderr F (log_finished) info: redis notify (call 947, PID 11577) exited with status 0 (execution time 70ms) 2025-09-29T21:08:03.956910912+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-09-29T21:08:04.040227547+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:949 2025-09-29T21:08:04.131782039+00:00 stderr F (log_finished) info: redis demote (call 949, PID 11623) exited with status 7 (execution time 91ms) 2025-09-29T21:08:04.179128484+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:950 2025-09-29T21:08:04.256339709+00:00 stderr F (log_finished) info: redis notify (call 950, PID 11685) exited with status 0 (execution time 77ms) 2025-09-29T21:08:04.346249730+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:951 2025-09-29T21:08:04.419495402+00:00 stderr F (log_finished) info: redis notify (call 951, PID 11731) exited with status 0 (execution time 73ms) 2025-09-29T21:08:04.462171121+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:952 2025-09-29T21:08:04.800719857+00:00 stderr F (log_finished) info: redis stop (call 952, PID 11777) exited with status 0 (execution time 338ms) 2025-09-29T21:08:05.020229674+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:958 2025-09-29T21:11:25.024592510+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11830] timed out after 3m20s 2025-09-29T21:11:25.024592510+00:00 stderr F (log_finished) info: redis start (call 958, PID 11830) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-09-29T21:11:25.075196056+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:966 2025-09-29T21:11:25.154842287+00:00 stderr F (log_finished) info: redis notify (call 966, PID 12098) exited with status 0 (execution time 79ms) 2025-09-29T21:11:25.267054452+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:967 2025-09-29T21:11:25.346090554+00:00 stderr F (log_finished) info: redis notify (call 967, PID 12144) exited with status 0 (execution time 79ms) 2025-09-29T21:11:25.389220338+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:968 2025-09-29T21:11:25.496574452+00:00 stderr F (log_finished) info: redis demote (call 968, PID 12190) exited with status 7 (execution time 107ms) 2025-09-29T21:11:25.544373551+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:969 2025-09-29T21:11:25.615534308+00:00 stderr F (log_finished) info: redis notify (call 969, PID 12252) exited with status 0 (execution time 71ms) 2025-09-29T21:11:25.770227817+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:970 2025-09-29T21:11:25.841963181+00:00 stderr F (log_finished) info: redis notify (call 970, PID 12298) exited with status 0 (execution time 71ms) 2025-09-29T21:11:25.884154186+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:971 2025-09-29T21:11:26.187034031+00:00 stderr F (log_finished) info: redis stop (call 971, PID 12344) exited with status 0 (execution time 302ms)