2025-12-04T11:01:06.736126871+00:00 stderr F + sudo -E kolla_set_configs 2025-12-04T11:01:06.750373195+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-12-04T11:01:06.804395643+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-12-04T11:01:06.804606938+00:00 stderr F INFO:__main__:Validating config file 2025-12-04T11:01:06.804659290+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-12-04T11:01:06.804682360+00:00 stderr F INFO:__main__:Copying service configuration files 2025-12-04T11:01:06.804804883+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-12-04T11:01:06.805474421+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-12-04T11:01:06.806207341+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-12-04T11:01:06.806628982+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-12-04T11:01:06.806898169+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-12-04T11:01:06.807123805+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-12-04T11:01:06.807438493+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-12-04T11:01:06.807708130+00:00 stderr F INFO:__main__:Writing out command to execute 2025-12-04T11:01:06.808024738+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-12-04T11:01:06.808146571+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-12-04T11:01:06.808260414+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-12-04T11:01:06.816328096+00:00 stderr F ++ cat /run_command 2025-12-04T11:01:06.818233266+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-12-04T11:01:06.818233266+00:00 stderr F + ARGS= 2025-12-04T11:01:06.818274717+00:00 stderr F + [[ ! -n '' ]] 2025-12-04T11:01:06.818274717+00:00 stderr F + . kolla_extend_start 2025-12-04T11:01:06.818401401+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-12-04T11:01:06.818409651+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-12-04T11:01:06.818409651+00:00 stderr F + umask 0022 2025-12-04T11:01:06.818409651+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-12-04T11:01:06.825588890+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-12-04T11:01:06.825656952+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-12-04T11:01:06.825768774+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-12-04T11:01:06.825818466+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-12-04T11:01:06.826230526+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-12-04T11:01:07.179990095+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-12-04T11:01:07.179990095+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-12-04T11:01:07.180315223+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-12-04T11:01:07.181093833+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-12-04T11:01:07.181093833+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-12-04T11:01:07.181093833+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-12-04T11:01:07.181093833+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-12-04T11:01:07.181093833+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-12-04T11:01:07.181093833+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-12-04T11:01:07.181093833+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-12-04T11:01:07.181093833+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-12-04T11:01:11.691330395+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-12-04T11:01:11.691330395+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-12-04T11:01:11.691330395+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-04T11:01:11.691804978+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-04T11:01:11.691854920+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-04T11:01:11.691886700+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-04T11:01:11.691966822+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-04T11:01:11.691997783+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-04T11:01:11.692036884+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-04T11:01:11.692075535+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-12-04T11:01:11.692172818+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-12-04T11:01:12.347957436+00:00 stderr F + sudo -E kolla_set_configs 2025-12-04T11:01:12.361630795+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-12-04T11:01:12.417735208+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-12-04T11:01:12.417905333+00:00 stderr F INFO:__main__:Validating config file 2025-12-04T11:01:12.417955154+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-12-04T11:01:12.417968874+00:00 stderr F INFO:__main__:Copying service configuration files 2025-12-04T11:01:12.418077027+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-12-04T11:01:12.418718964+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-12-04T11:01:12.419420282+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-12-04T11:01:12.420813149+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-12-04T11:01:12.420813149+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-12-04T11:01:12.420813149+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-12-04T11:01:12.420813149+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-12-04T11:01:12.420813149+00:00 stderr F INFO:__main__:Writing out command to execute 2025-12-04T11:01:12.421012994+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-12-04T11:01:12.421136337+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-12-04T11:01:12.421270301+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-12-04T11:01:12.429459816+00:00 stderr F ++ cat /run_command 2025-12-04T11:01:12.431081909+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-12-04T11:01:12.431102710+00:00 stderr F + ARGS= 2025-12-04T11:01:12.431112780+00:00 stderr F + [[ ! -n '' ]] 2025-12-04T11:01:12.431122510+00:00 stderr F + . kolla_extend_start 2025-12-04T11:01:12.431267014+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-12-04T11:01:12.431281034+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-12-04T11:01:12.431288324+00:00 stderr F + umask 0022 2025-12-04T11:01:12.431297995+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-12-04T11:01:12.437544218+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-12-04T11:01:12.437812635+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-12-04T11:01:12.437871297+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-12-04T11:01:12.437919378+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-12-04T11:01:12.438278947+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-12-04T11:01:12.619811264+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-12-04T11:01:12.619982808+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-12-04T11:01:12.620024660+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-12-04T11:01:12.620067121+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-12-04T11:01:12.620099391+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-12-04T11:01:12.620142923+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-12-04T11:01:12.620182774+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-12-04T11:01:12.620237155+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-12-04T11:01:12.620237155+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-12-04T11:01:13.212617509+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-12-04T11:01:13.212617509+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x55600ce2d190 id: b3e54fbd-5e49-44d4-ac44-d6c823e63b09 2025-12-04T11:01:13.753118840+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-12-04T11:01:14.280852177+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-12-04T11:01:14.321733680+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-12-04T11:01:14.404776610+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-12-04T11:01:14.715043477+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-12-04T11:01:18.609675735+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-12-04T11:01:18.609675735+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 3.895s) 2025-12-04T11:01:18.688117525+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-12-04T11:01:18.752591358+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 64ms) 2025-12-04T11:01:18.849189215+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-12-04T11:01:18.909010225+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 60ms) 2025-12-04T11:01:18.951964452+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-12-04T11:01:19.852052876+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 901ms) 2025-12-04T11:01:19.932105677+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-12-04T11:01:20.231248142+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 299ms) 2025-12-04T12:03:02.388544296+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:910 2025-12-04T12:03:02.467376479+00:00 stderr F (log_finished) info: redis notify (call 910, PID 11109) exited with status 0 (execution time 80ms) 2025-12-04T12:03:02.509804451+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-12-04T12:03:02.592081218+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:912 2025-12-04T12:03:02.683389880+00:00 stderr F (log_finished) info: redis demote (call 912, PID 11155) exited with status 7 (execution time 91ms) 2025-12-04T12:03:02.730974283+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:913 2025-12-04T12:03:02.806556757+00:00 stderr F (log_finished) info: redis notify (call 913, PID 11217) exited with status 0 (execution time 76ms) 2025-12-04T12:03:02.916665570+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:914 2025-12-04T12:03:02.990839786+00:00 stderr F (log_finished) info: redis notify (call 914, PID 11263) exited with status 0 (execution time 74ms) 2025-12-04T12:03:03.034046610+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:915 2025-12-04T12:03:03.353622676+00:00 stderr F (log_finished) info: redis stop (call 915, PID 11309) exited with status 0 (execution time 319ms) 2025-12-04T12:03:03.566170603+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:921 2025-12-04T12:06:23.569219958+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11362] timed out after 3m20s 2025-12-04T12:06:23.569219958+00:00 stderr F (log_finished) info: redis start (call 921, PID 11362) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.003s) 2025-12-04T12:06:23.614181574+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:929 2025-12-04T12:06:23.672815121+00:00 stderr F (log_finished) info: redis notify (call 929, PID 11630) exited with status 0 (execution time 58ms) 2025-12-04T12:06:23.788075692+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:930 2025-12-04T12:06:23.858723045+00:00 stderr F (log_finished) info: redis notify (call 930, PID 11676) exited with status 0 (execution time 71ms) 2025-12-04T12:06:23.901230966+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:931 2025-12-04T12:06:23.981203316+00:00 stderr F (log_finished) info: redis demote (call 931, PID 11722) exited with status 7 (execution time 79ms) 2025-12-04T12:06:24.025942687+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:932 2025-12-04T12:06:24.090418248+00:00 stderr F (log_finished) info: redis notify (call 932, PID 11784) exited with status 0 (execution time 64ms) 2025-12-04T12:06:24.225676306+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:933 2025-12-04T12:06:24.296161855+00:00 stderr F (log_finished) info: redis notify (call 933, PID 11830) exited with status 0 (execution time 71ms) 2025-12-04T12:06:24.339035245+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:934 2025-12-04T12:06:24.650464902+00:00 stderr F (log_finished) info: redis stop (call 934, PID 11876) exited with status 0 (execution time 311ms)