2025-11-25T15:25:54.877268500+00:00 stderr F + sudo -E kolla_set_configs 2025-11-25T15:25:54.894960067+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-25T15:25:54.956936035+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-25T15:25:54.957108419+00:00 stderr F INFO:__main__:Validating config file 2025-11-25T15:25:54.957160900+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-25T15:25:54.957178841+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-25T15:25:54.957312375+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-25T15:25:54.957877760+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-25T15:25:54.958571788+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-25T15:25:54.959067051+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-25T15:25:54.959396060+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-25T15:25:54.959620236+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-25T15:25:54.959855292+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-25T15:25:54.959976205+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-25T15:25:54.960094529+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-25T15:25:54.968793739+00:00 stderr F ++ cat /run_command 2025-11-25T15:25:54.970756700+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-25T15:25:54.970792961+00:00 stderr F + ARGS= 2025-11-25T15:25:54.970834032+00:00 stderr F + [[ ! -n '' ]] 2025-11-25T15:25:54.970839282+00:00 stderr F + . kolla_extend_start 2025-11-25T15:25:54.970987296+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-25T15:25:54.971008346+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-25T15:25:54.971034057+00:00 stderr F + umask 0022 2025-11-25T15:25:54.971061958+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-25T15:25:54.981548255+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-11-25T15:25:54.981593696+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-25T15:25:54.981749530+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-25T15:25:54.981827452+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-25T15:25:54.982311065+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-25T15:25:56.450018769+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-11-25T15:25:56.450114502+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-11-25T15:25:56.450633006+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-25T15:25:56.451054427+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-25T15:25:56.451054427+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-25T15:25:56.451077728+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-25T15:25:56.451142570+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-25T15:25:56.451173090+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-25T15:25:56.451234582+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-25T15:25:56.451314204+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-25T15:25:56.451314204+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-25T15:25:59.838064746+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-11-25T15:25:59.838064746+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-11-25T15:25:59.838064746+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-25T15:25:59.838244961+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-25T15:25:59.838263811+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-25T15:25:59.838297422+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-25T15:25:59.838307882+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-25T15:25:59.838337463+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-25T15:25:59.838382024+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-25T15:25:59.838382024+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-25T15:25:59.838460956+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-11-25T15:26:00.449206801+00:00 stderr F + sudo -E kolla_set_configs 2025-11-25T15:26:00.461506916+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-25T15:26:00.523313599+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-25T15:26:00.523313599+00:00 stderr F INFO:__main__:Validating config file 2025-11-25T15:26:00.523313599+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-25T15:26:00.523313599+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-25T15:26:00.523313599+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-25T15:26:00.530052087+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-25T15:26:00.530052087+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-25T15:26:00.530052087+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-25T15:26:00.530052087+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-25T15:26:00.530052087+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-25T15:26:00.530052087+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-25T15:26:00.530052087+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-25T15:26:00.530052087+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-25T15:26:00.535205023+00:00 stderr F ++ cat /run_command 2025-11-25T15:26:00.536635391+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-25T15:26:00.536675612+00:00 stderr F + ARGS= 2025-11-25T15:26:00.536716403+00:00 stderr F + [[ ! -n '' ]] 2025-11-25T15:26:00.536721973+00:00 stderr F + . kolla_extend_start 2025-11-25T15:26:00.536886097+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-25T15:26:00.536891887+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-25T15:26:00.536920868+00:00 stderr F + umask 0022 2025-11-25T15:26:00.536945499+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-25T15:26:00.545648739+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-11-25T15:26:00.545857814+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-25T15:26:00.545902155+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-25T15:26:00.545927586+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-25T15:26:00.546237385+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-25T15:26:01.440203162+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-25T15:26:01.440498840+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-25T15:26:01.440498840+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-25T15:26:01.440498840+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-25T15:26:01.440554601+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-25T15:26:01.440580512+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-25T15:26:01.440646603+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-25T15:26:01.440762266+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-25T15:26:01.440762266+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-25T15:26:02.722367624+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-11-25T15:26:02.722881118+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x56525a7451a0 id: adb83830-36e8-41c1-b104-bdbf9aa05bf9 2025-11-25T15:26:03.265728028+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-11-25T15:26:03.402593284+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-11-25T15:26:03.443516786+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-11-25T15:26:03.525672536+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-11-25T15:26:03.937045764+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-11-25T15:26:07.858397118+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-11-25T15:26:07.858397118+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 3.921s) 2025-11-25T15:26:07.936854120+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-11-25T15:26:08.006959002+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 70ms) 2025-11-25T15:26:08.099779224+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-11-25T15:26:08.169908927+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 70ms) 2025-11-25T15:26:08.214729291+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-11-25T15:26:09.127685600+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 913ms) 2025-11-25T15:26:09.239366881+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-11-25T15:26:09.541243596+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 333ms) 2025-11-25T16:29:12.908663124+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:929 2025-11-25T16:29:12.974483082+00:00 stderr F (log_finished) info: redis notify (call 929, PID 11343) exited with status 0 (execution time 68ms) 2025-11-25T16:29:13.016543178+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-11-25T16:29:13.099813876+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:931 2025-11-25T16:29:13.207543356+00:00 stderr F (log_finished) info: redis demote (call 931, PID 11389) exited with status 7 (execution time 107ms) 2025-11-25T16:29:13.252840718+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:932 2025-11-25T16:29:13.330109434+00:00 stderr F (log_finished) info: redis notify (call 932, PID 11451) exited with status 0 (execution time 77ms) 2025-11-25T16:29:13.429021965+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:933 2025-11-25T16:29:13.505116170+00:00 stderr F (log_finished) info: redis notify (call 933, PID 11497) exited with status 0 (execution time 76ms) 2025-11-25T16:29:13.547915075+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:934 2025-11-25T16:29:13.856381723+00:00 stderr F (log_finished) info: redis stop (call 934, PID 11543) exited with status 0 (execution time 308ms) 2025-11-25T16:29:14.070087964+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:940 2025-11-25T16:32:34.072744316+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11596] timed out after 3m20s 2025-11-25T16:32:34.072744316+00:00 stderr F (log_finished) info: redis start (call 940, PID 11596) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-11-25T16:32:39.867987713+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:948 2025-11-25T16:32:39.932369612+00:00 stderr F (log_finished) info: redis notify (call 948, PID 11865) exited with status 0 (execution time 64ms) 2025-11-25T16:32:40.026933565+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:949 2025-11-25T16:32:40.135724762+00:00 stderr F (log_finished) info: redis notify (call 949, PID 11911) exited with status 0 (execution time 108ms) 2025-11-25T16:32:40.178590839+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:950 2025-11-25T16:32:40.269919706+00:00 stderr F (log_finished) info: redis demote (call 950, PID 11957) exited with status 7 (execution time 91ms) 2025-11-25T16:32:40.314776487+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:951 2025-11-25T16:32:40.386240746+00:00 stderr F (log_finished) info: redis notify (call 951, PID 12019) exited with status 0 (execution time 71ms) 2025-11-25T16:32:40.487889331+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:952 2025-11-25T16:32:40.559274768+00:00 stderr F (log_finished) info: redis notify (call 952, PID 12065) exited with status 0 (execution time 71ms) 2025-11-25T16:32:40.601812226+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:953 2025-11-25T16:32:40.927240034+00:00 stderr F (log_finished) info: redis stop (call 953, PID 12111) exited with status 0 (execution time 326ms)