2025-11-24T20:18:21.654604684+00:00 stderr F + sudo -E kolla_set_configs 2025-11-24T20:18:21.669903605+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-24T20:18:21.733702199+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-24T20:18:21.733858943+00:00 stderr F INFO:__main__:Validating config file 2025-11-24T20:18:21.733889814+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-24T20:18:21.733908855+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-24T20:18:21.733986357+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-24T20:18:21.734433271+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-24T20:18:21.735070090+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-24T20:18:21.735492493+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-11-24T20:18:21.735652338+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-11-24T20:18:21.735814023+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-24T20:18:21.735981218+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-24T20:18:21.736168634+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-24T20:18:21.736444973+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-24T20:18:21.736524985+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-24T20:18:21.736606308+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-24T20:18:21.742360865+00:00 stderr F ++ cat /run_command 2025-11-24T20:18:21.743616093+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-24T20:18:21.743642194+00:00 stderr F + ARGS= 2025-11-24T20:18:21.743674745+00:00 stderr F + [[ ! -n '' ]] 2025-11-24T20:18:21.743679715+00:00 stderr F + . kolla_extend_start 2025-11-24T20:18:21.743818439+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-24T20:18:21.743824759+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-24T20:18:21.743843490+00:00 stderr F + umask 0022 2025-11-24T20:18:21.743858880+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-24T20:18:21.751472585+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-11-24T20:18:21.751514896+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-24T20:18:21.751600299+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-24T20:18:21.751651720+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-24T20:18:21.752052843+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-24T20:18:22.078153358+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-11-24T20:18:22.078153358+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-11-24T20:18:22.078255981+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-24T20:18:22.078342164+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-24T20:18:22.078385505+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-24T20:18:22.078430916+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-24T20:18:22.078475058+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-24T20:18:22.078521209+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-24T20:18:22.078565090+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-24T20:18:22.078689384+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-24T20:18:22.078725555+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-24T20:18:26.446623863+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-11-24T20:18:26.446623863+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-11-24T20:18:26.446623863+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-24T20:18:26.446623863+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-24T20:18:26.446623863+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-24T20:18:26.446623863+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-24T20:18:26.446623863+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-24T20:18:26.446623863+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-24T20:18:26.446623863+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-24T20:18:26.446623863+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-24T20:18:26.446623863+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-11-24T20:18:27.111575914+00:00 stderr F + sudo -E kolla_set_configs 2025-11-24T20:18:27.122663105+00:00 stderr P sudo: unable to send audit message 2025-11-24T20:18:27.122739777+00:00 stderr F : Operation not permitted 2025-11-24T20:18:27.198620452+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-24T20:18:27.198620452+00:00 stderr F INFO:__main__:Validating config file 2025-11-24T20:18:27.198620452+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-24T20:18:27.198620452+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-24T20:18:27.199176840+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-24T20:18:27.199354976+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-24T20:18:27.200052347+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-24T20:18:27.200443699+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/stunnel/stunnel.conf to /etc/stunnel/stunnel.conf 2025-11-24T20:18:27.200674316+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis-tls.conf to /etc/redis-tls.conf 2025-11-24T20:18:27.200897403+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-24T20:18:27.201230553+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-24T20:18:27.201447299+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-24T20:18:27.201679546+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-24T20:18:27.201798720+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-24T20:18:27.201928025+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-24T20:18:27.209309841+00:00 stderr F ++ cat /run_command 2025-11-24T20:18:27.210703025+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-24T20:18:27.210721695+00:00 stderr F + ARGS= 2025-11-24T20:18:27.210772927+00:00 stderr F + [[ ! -n '' ]] 2025-11-24T20:18:27.210772927+00:00 stderr F + . kolla_extend_start 2025-11-24T20:18:27.210933502+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-24T20:18:27.210941682+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-24T20:18:27.210964873+00:00 stderr F + umask 0022 2025-11-24T20:18:27.210988823+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-24T20:18:27.224040474+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-11-24T20:18:27.224040474+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-24T20:18:27.224040474+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-24T20:18:27.224040474+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-24T20:18:27.224040474+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-24T20:18:27.581924627+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-24T20:18:27.581924627+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-24T20:18:27.581924627+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-24T20:18:27.581924627+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-24T20:18:27.581924627+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-24T20:18:27.581924627+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-24T20:18:27.581924627+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-24T20:18:27.581924627+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-24T20:18:27.581924627+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-24T20:18:27.804882469+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-11-24T20:18:27.804882469+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x564dd9dd2560 id: d47105a4-b62d-45e5-b9fb-c28cc07f3884 2025-11-24T20:18:28.347581088+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-11-24T20:18:28.481233820+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-11-24T20:18:28.522189311+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-11-24T20:18:28.605175014+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-11-24T20:18:28.940989258+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-11-24T20:18:32.863053286+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-11-24T20:18:32.863053286+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 3.923s) 2025-11-24T20:18:32.937691573+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-11-24T20:18:33.007608554+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 69ms) 2025-11-24T20:18:33.119130686+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-11-24T20:18:33.189198692+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 70ms) 2025-11-24T20:18:33.231764412+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-11-24T20:18:34.149252914+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 918ms) 2025-11-24T20:18:34.229687159+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-11-24T20:18:34.561842500+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 332ms) 2025-11-24T21:21:16.775211669+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:924 2025-11-24T21:21:16.837250709+00:00 stderr F (log_finished) info: redis notify (call 924, PID 11284) exited with status 0 (execution time 62ms) 2025-11-24T21:21:16.880304514+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-11-24T21:21:16.964409713+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:926 2025-11-24T21:21:17.064084616+00:00 stderr F (log_finished) info: redis demote (call 926, PID 11330) exited with status 7 (execution time 99ms) 2025-11-24T21:21:17.110355616+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:927 2025-11-24T21:21:17.179459918+00:00 stderr F (log_finished) info: redis notify (call 927, PID 11392) exited with status 0 (execution time 69ms) 2025-11-24T21:21:17.280667757+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:928 2025-11-24T21:21:17.349524300+00:00 stderr F (log_finished) info: redis notify (call 928, PID 11438) exited with status 0 (execution time 68ms) 2025-11-24T21:21:17.392658868+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:929 2025-11-24T21:21:17.701595553+00:00 stderr F (log_finished) info: redis stop (call 929, PID 11484) exited with status 0 (execution time 308ms) 2025-11-24T21:21:17.914750021+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:935 2025-11-24T21:24:37.918179305+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11537] timed out after 3m20s 2025-11-24T21:24:37.918179305+00:00 stderr F (log_finished) info: redis start (call 935, PID 11537) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.003s) 2025-11-24T21:24:44.368297529+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:943 2025-11-24T21:24:44.449337710+00:00 stderr F (log_finished) info: redis notify (call 943, PID 11805) exited with status 0 (execution time 81ms) 2025-11-24T21:24:44.577798144+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:944 2025-11-24T21:24:44.656577796+00:00 stderr F (log_finished) info: redis notify (call 944, PID 11851) exited with status 0 (execution time 78ms) 2025-11-24T21:24:44.699820839+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:945 2025-11-24T21:24:44.803621368+00:00 stderr F (log_finished) info: redis demote (call 945, PID 11897) exited with status 7 (execution time 104ms) 2025-11-24T21:24:44.849674548+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:946 2025-11-24T21:24:44.925412767+00:00 stderr F (log_finished) info: redis notify (call 946, PID 11959) exited with status 0 (execution time 75ms) 2025-11-24T21:24:45.034799766+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:947 2025-11-24T21:24:45.109221825+00:00 stderr F (log_finished) info: redis notify (call 947, PID 12005) exited with status 0 (execution time 74ms) 2025-11-24T21:24:45.152762858+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:948 2025-11-24T21:24:45.480221385+00:00 stderr F (log_finished) info: redis stop (call 948, PID 12051) exited with status 0 (execution time 327ms)