2025-11-26T07:53:24.395344313+00:00 stderr F + sudo -E kolla_set_configs 2025-11-26T07:53:24.407976290+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-26T07:53:24.468968161+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-26T07:53:24.468968161+00:00 stderr F INFO:__main__:Validating config file 2025-11-26T07:53:24.468968161+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-26T07:53:24.468968161+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-26T07:53:24.468968161+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-26T07:53:24.469325012+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-26T07:53:24.470060136+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-26T07:53:24.470440258+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-26T07:53:24.470682715+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-26T07:53:24.470895712+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-26T07:53:24.471156910+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-26T07:53:24.471279624+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-26T07:53:24.471395918+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-26T07:53:24.479386468+00:00 stderr F ++ cat /run_command 2025-11-26T07:53:24.480728741+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-26T07:53:24.480767632+00:00 stderr F + ARGS= 2025-11-26T07:53:24.480807463+00:00 stderr F + [[ ! -n '' ]] 2025-11-26T07:53:24.480807463+00:00 stderr F + . kolla_extend_start 2025-11-26T07:53:24.480987369+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-26T07:53:24.480994979+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-26T07:53:24.481019630+00:00 stderr F + umask 0022 2025-11-26T07:53:24.481044231+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-26T07:53:24.499499979+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-11-26T07:53:24.499499979+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-26T07:53:24.499499979+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-26T07:53:24.499499979+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-26T07:53:24.499499979+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-26T07:53:25.113989235+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-11-26T07:53:25.114091508+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-11-26T07:53:25.114665676+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-26T07:53:25.115024887+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-26T07:53:25.115074889+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-26T07:53:25.115126340+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-26T07:53:25.115167582+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-26T07:53:25.115214683+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-26T07:53:25.115258484+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-26T07:53:25.115331787+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-26T07:53:25.115331787+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-26T07:53:29.359889644+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-11-26T07:53:29.360305406+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-11-26T07:53:29.360305406+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-26T07:53:29.360601816+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-26T07:53:29.360601816+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-26T07:53:29.360690419+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-26T07:53:29.360740651+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-26T07:53:29.360824043+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-26T07:53:29.360872595+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-26T07:53:29.360973248+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-11-26T07:53:29.361108302+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-11-26T07:53:29.878051739+00:00 stderr F + sudo -E kolla_set_configs 2025-11-26T07:53:29.887621160+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-11-26T07:53:29.925687333+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-11-26T07:53:29.925851578+00:00 stderr F INFO:__main__:Validating config file 2025-11-26T07:53:29.925889809+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-11-26T07:53:29.925901679+00:00 stderr F INFO:__main__:Copying service configuration files 2025-11-26T07:53:29.926002803+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-11-26T07:53:29.926439576+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-11-26T07:53:29.926978424+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-11-26T07:53:29.927233212+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-11-26T07:53:29.927419497+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-11-26T07:53:29.927586063+00:00 stderr F INFO:__main__:Writing out command to execute 2025-11-26T07:53:29.927763018+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-11-26T07:53:29.927849221+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-11-26T07:53:29.927979085+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-11-26T07:53:29.934462548+00:00 stderr F ++ cat /run_command 2025-11-26T07:53:29.937048549+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-11-26T07:53:29.937073340+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-11-26T07:53:29.937073340+00:00 stderr F + ARGS= 2025-11-26T07:53:29.937073340+00:00 stderr F + [[ ! -n '' ]] 2025-11-26T07:53:29.937073340+00:00 stderr F + . kolla_extend_start 2025-11-26T07:53:29.937073340+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-11-26T07:53:29.937073340+00:00 stderr F + umask 0022 2025-11-26T07:53:29.937073340+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-11-26T07:53:29.941501239+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-11-26T07:53:29.941784438+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-11-26T07:53:29.941827309+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-11-26T07:53:29.941838169+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-11-26T07:53:29.942189740+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-11-26T07:53:30.211601497+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-11-26T07:53:30.211782002+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-11-26T07:53:30.211828594+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-11-26T07:53:30.211878135+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-11-26T07:53:30.211961558+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-11-26T07:53:30.212012360+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-11-26T07:53:30.212057261+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-11-26T07:53:30.212133143+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-11-26T07:53:30.212133143+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-11-26T07:53:30.808815491+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-11-26T07:53:30.809395000+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x555e9cdf9350 id: 89d6c820-eb35-4cca-bc3e-3a99f9ccc0b6 2025-11-26T07:53:31.354428807+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-11-26T07:53:31.505380470+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-11-26T07:53:31.546348115+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-11-26T07:53:31.628358586+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-11-26T07:53:32.036570494+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-11-26T07:53:36.031798304+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-11-26T07:53:36.031798304+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 3.996s) 2025-11-26T07:53:36.110577704+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-11-26T07:53:36.182175349+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 71ms) 2025-11-26T07:53:36.265427149+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-11-26T07:53:36.328440055+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 63ms) 2025-11-26T07:53:36.371539706+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-11-26T07:53:37.265141392+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 894ms) 2025-11-26T07:53:37.346004587+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-11-26T07:53:37.677558892+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 331ms) 2025-11-26T08:57:20.997546658+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:938 2025-11-26T08:57:21.069586770+00:00 stderr F (log_finished) info: redis notify (call 938, PID 11460) exited with status 0 (execution time 73ms) 2025-11-26T08:57:21.112599603+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-11-26T08:57:21.195790810+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:940 2025-11-26T08:57:21.339998017+00:00 stderr F (log_finished) info: redis demote (call 940, PID 11506) exited with status 7 (execution time 144ms) 2025-11-26T08:57:21.385640091+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:941 2025-11-26T08:57:21.469170890+00:00 stderr F (log_finished) info: redis notify (call 941, PID 11568) exited with status 0 (execution time 83ms) 2025-11-26T08:57:21.560689916+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:942 2025-11-26T08:57:21.640299013+00:00 stderr F (log_finished) info: redis notify (call 942, PID 11614) exited with status 0 (execution time 79ms) 2025-11-26T08:57:21.688048462+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:943 2025-11-26T08:57:22.017648494+00:00 stderr F (log_finished) info: redis stop (call 943, PID 11660) exited with status 0 (execution time 330ms after being queued 3ms) 2025-11-26T08:57:22.227488135+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:949 2025-11-26T09:00:42.230580290+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[11713] timed out after 3m20s 2025-11-26T09:00:42.230580290+00:00 stderr F (log_finished) info: redis start (call 949, PID 11713) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-11-26T09:00:42.276484453+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:957 2025-11-26T09:00:42.343883991+00:00 stderr F (log_finished) info: redis notify (call 957, PID 11981) exited with status 0 (execution time 67ms) 2025-11-26T09:00:42.437405299+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:958 2025-11-26T09:00:42.505682475+00:00 stderr F (log_finished) info: redis notify (call 958, PID 12027) exited with status 0 (execution time 68ms) 2025-11-26T09:00:42.547636085+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:959 2025-11-26T09:00:42.639177130+00:00 stderr F (log_finished) info: redis demote (call 959, PID 12073) exited with status 7 (execution time 91ms) 2025-11-26T09:00:42.687672793+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:960 2025-11-26T09:00:42.757343941+00:00 stderr F (log_finished) info: redis notify (call 960, PID 12135) exited with status 0 (execution time 69ms) 2025-11-26T09:00:42.859613050+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:961 2025-11-26T09:00:42.937217935+00:00 stderr F (log_finished) info: redis notify (call 961, PID 12181) exited with status 0 (execution time 77ms) 2025-11-26T09:00:42.980627949+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:962 2025-11-26T09:00:43.288290282+00:00 stderr F (log_finished) info: redis stop (call 962, PID 12227) exited with status 0 (execution time 308ms)