2025-11-27T08:12:04.913646652+00:00 stderr F + sudo -E kolla_set_configs 2025-11-27T08:12:04.926856421+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-27T08:12:04.973734964+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-27T08:12:04.973916680+00:00 stderr F INFO:__main__:Validating config file 2025-11-27T08:12:04.973955231+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-27T08:12:04.973967921+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-27T08:12:04.974094945+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-27T08:12:04.974800067+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-27T08:12:04.975482888+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-27T08:12:04.975757246+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-27T08:12:04.976000064+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-27T08:12:04.976243351+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-27T08:12:04.976517430+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-27T08:12:04.976648364+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-27T08:12:04.976773418+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-27T08:12:04.984273180+00:00 stderr F ++ cat /run_command 2025-11-27T08:12:04.986000884+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-27T08:12:04.986022724+00:00 stderr F + ARGS= 2025-11-27T08:12:04.986032725+00:00 stderr F + [[ ! -n '' ]] 2025-11-27T08:12:04.986042055+00:00 stderr F + . kolla_extend_start 2025-11-27T08:12:04.986192160+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-27T08:12:04.986204190+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-27T08:12:04.986204190+00:00 stderr F + umask 0022 2025-11-27T08:12:04.986215060+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-27T08:12:04.993912979+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-11-27T08:12:04.993956960+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-27T08:12:04.994192878+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-27T08:12:04.994431435+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-27T08:12:04.994774375+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-27T08:12:05.139106768+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-11-27T08:12:05.139106768+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-11-27T08:12:05.139106768+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-27T08:12:05.139106768+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-27T08:12:05.139172570+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-27T08:12:05.139244362+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-27T08:12:05.139296194+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-27T08:12:05.139357256+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-27T08:12:05.139415997+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-27T08:12:05.139527441+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-27T08:12:05.139588883+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-27T08:12:19.784742555+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-11-27T08:12:19.784742555+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-11-27T08:12:19.784742555+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-27T08:12:19.785159748+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-27T08:12:19.785199399+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-27T08:12:19.785239640+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-27T08:12:19.785250150+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-27T08:12:19.785293022+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-27T08:12:19.785321443+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-27T08:12:19.785348823+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-27T08:12:19.785425516+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-11-27T08:12:20.477782408+00:00 stderr F + sudo -E kolla_set_configs 2025-11-27T08:12:20.495192607+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-27T08:12:20.537257320+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-27T08:12:20.537257320+00:00 stderr F INFO:__main__:Validating config file 2025-11-27T08:12:20.537257320+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-27T08:12:20.537257320+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-27T08:12:20.537257320+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-27T08:12:20.537257320+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-27T08:12:20.537257320+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-27T08:12:20.537257320+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-27T08:12:20.537257320+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-27T08:12:20.537403455+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-27T08:12:20.537658803+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-27T08:12:20.537797207+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-27T08:12:20.537956672+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-27T08:12:20.546473687+00:00 stderr F ++ cat /run_command 2025-11-27T08:12:20.548548140+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-27T08:12:20.548548140+00:00 stderr F + ARGS= 2025-11-27T08:12:20.548583831+00:00 stderr F + [[ ! -n '' ]] 2025-11-27T08:12:20.548583831+00:00 stderr F + . kolla_extend_start 2025-11-27T08:12:20.548772567+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-27T08:12:20.548782487+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-27T08:12:20.548782487+00:00 stderr F + umask 0022 2025-11-27T08:12:20.548826179+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-27T08:12:20.558408376+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-11-27T08:12:20.558882721+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-27T08:12:20.558955283+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-27T08:12:20.558974824+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-27T08:12:20.559556361+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-27T08:12:20.686680401+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-27T08:12:20.686726552+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-27T08:12:20.686787064+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-27T08:12:20.686818615+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-27T08:12:20.686872327+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-27T08:12:20.686904838+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-27T08:12:20.686942849+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-27T08:12:20.687015061+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-27T08:12:20.687015061+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-27T08:12:21.247527088+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.103 2025-11-27T08:12:21.247527088+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x55daf57194a0 id: e5a81711-286c-4d54-8fee-91b3492c875b 2025-11-27T08:12:21.791513943+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-11-27T08:12:34.932050375+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-11-27T08:12:34.972736815+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-11-27T08:12:35.057448270+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-11-27T08:12:35.882318068+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-11-27T08:12:39.902730588+00:00 stderr F (log_op_output) info: redis_start_0[56] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-11-27T08:12:39.902730588+00:00 stderr F (log_finished) info: redis start (call 8, PID 56) exited with status 0 (execution time 4.019s) 2025-11-27T08:12:40.093920942+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-11-27T08:12:40.170622339+00:00 stderr F (log_finished) info: redis notify (call 38, PID 218) exited with status 0 (execution time 77ms) 2025-11-27T08:12:44.479582420+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-11-27T08:12:44.553689015+00:00 stderr F (log_finished) info: redis notify (call 39, PID 264) exited with status 0 (execution time 74ms) 2025-11-27T08:12:48.914163933+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:40 2025-11-27T08:12:49.003599254+00:00 stderr F (log_finished) info: redis notify (call 40, PID 310) exited with status 0 (execution time 90ms) 2025-11-27T08:12:49.182759595+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:41 2025-11-27T08:12:49.241643500+00:00 stderr F (log_finished) info: redis notify (call 41, PID 356) exited with status 0 (execution time 58ms) 2025-11-27T08:12:49.347933693+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:42 2025-11-27T08:12:50.266350569+00:00 stderr F (log_finished) info: redis promote (call 42, PID 402) exited with status 0 (execution time 919ms) 2025-11-27T08:12:50.346888554+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:55 2025-11-27T08:12:50.692066379+00:00 stderr F (log_finished) info: redis notify (call 55, PID 475) exited with status 0 (execution time 345ms) 2025-11-27T09:16:15.590815381+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:936 2025-11-27T09:16:15.662777892+00:00 stderr F (log_finished) info: redis notify (call 936, PID 11455) exited with status 0 (execution time 73ms) 2025-11-27T09:16:16.295832451+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:937 2025-11-27T09:16:16.364227911+00:00 stderr F (log_finished) info: redis notify (call 937, PID 11501) exited with status 0 (execution time 68ms) 2025-11-27T09:16:16.620856268+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:938 2025-11-27T09:16:16.695752938+00:00 stderr F (log_finished) info: redis notify (call 938, PID 11547) exited with status 0 (execution time 74ms) 2025-11-27T09:16:17.307899402+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:939 2025-11-27T09:16:17.385909309+00:00 stderr F (log_finished) info: redis notify (call 939, PID 11639) exited with status 0 (execution time 78ms) 2025-11-27T09:16:17.540804317+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:940 2025-11-27T09:16:17.616213314+00:00 stderr F (log_finished) info: redis notify (call 940, PID 11685) exited with status 0 (execution time 75ms) 2025-11-27T09:16:17.663472932+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-11-27T09:16:17.747701820+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:942 2025-11-27T09:16:17.848947433+00:00 stderr F (log_finished) info: redis demote (call 942, PID 11731) exited with status 7 (execution time 101ms) 2025-11-27T09:16:17.899934566+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:943 2025-11-27T09:16:17.983508625+00:00 stderr F (log_finished) info: redis notify (call 943, PID 11793) exited with status 0 (execution time 83ms) 2025-11-27T09:16:18.140586770+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:944 2025-11-27T09:16:18.206905376+00:00 stderr F (log_finished) info: redis notify (call 944, PID 11839) exited with status 0 (execution time 66ms) 2025-11-27T09:16:18.254534396+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:945 2025-11-27T09:16:18.550590278+00:00 stderr F (log_finished) info: redis stop (call 945, PID 11885) exited with status 0 (execution time 295ms) 2025-11-27T09:16:18.797868247+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:951 2025-11-27T09:19:38.801276011+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11938] timed out after 3m20s 2025-11-27T09:19:38.801276011+00:00 stderr F (log_finished) info: redis start (call 951, PID 11938) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-11-27T09:19:39.007819274+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:958 2025-11-27T09:19:39.081591469+00:00 stderr F (log_finished) info: redis notify (call 958, PID 12206) exited with status 0 (execution time 73ms) 2025-11-27T09:19:39.128774225+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:959 2025-11-27T09:19:39.239059737+00:00 stderr F (log_finished) info: redis demote (call 959, PID 12252) exited with status 7 (execution time 110ms) 2025-11-27T09:19:39.290924487+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:960 2025-11-27T09:19:39.359571164+00:00 stderr F (log_finished) info: redis notify (call 960, PID 12314) exited with status 0 (execution time 68ms) 2025-11-27T09:19:39.554112826+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:961 2025-11-27T09:19:39.629354268+00:00 stderr F (log_finished) info: redis notify (call 961, PID 12360) exited with status 0 (execution time 75ms) 2025-11-27T09:19:39.677054849+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:962 2025-11-27T09:19:39.992476639+00:00 stderr F (log_finished) info: redis stop (call 962, PID 12406) exited with status 0 (execution time 315ms)