2025-10-02T02:36:09.963621753+00:00 stderr F + sudo -E kolla_set_configs 2025-10-02T02:36:09.973326739+00:00 stderr P sudo 2025-10-02T02:36:09.973372110+00:00 stderr P : 2025-10-02T02:36:09.973383760+00:00 stderr P unable to send audit message 2025-10-02T02:36:09.973394891+00:00 stderr P : 2025-10-02T02:36:09.973405731+00:00 stderr P Operation not permitted 2025-10-02T02:36:09.973416141+00:00 stderr F 2025-10-02T02:36:10.035207994+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-02T02:36:10.035399730+00:00 stderr F INFO:__main__:Validating config file 2025-10-02T02:36:10.035451192+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-02T02:36:10.035451192+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-02T02:36:10.035627398+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-02T02:36:10.036231926+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-02T02:36:10.036949377+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-02T02:36:10.037219576+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-02T02:36:10.037475323+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-02T02:36:10.037730731+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-02T02:36:10.037964818+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-02T02:36:10.038087012+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-02T02:36:10.038206795+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-02T02:36:10.051756738+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-02T02:36:10.051797439+00:00 stderr F ++ cat /run_command 2025-10-02T02:36:10.051797439+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-02T02:36:10.051797439+00:00 stderr F + ARGS= 2025-10-02T02:36:10.051797439+00:00 stderr F + [[ ! -n '' ]] 2025-10-02T02:36:10.051797439+00:00 stderr F + . kolla_extend_start 2025-10-02T02:36:10.051797439+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-02T02:36:10.051797439+00:00 stderr F + umask 0022 2025-10-02T02:36:10.051797439+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-02T02:36:10.057954648+00:00 stderr F (pcmk__add_logfile) notice: Additional logging available in /var/log/pacemaker/pacemaker.log 2025-10-02T02:36:10.058027650+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-02T02:36:10.058128113+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-02T02:36:10.058184005+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-02T02:36:10.058592627+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-02T02:36:10.267081019+00:00 stderr F (lrmd__init_remote_key) warning: Could not read Pacemaker Remote key from default location /etc/pacemaker/authkey (or fallback location /etc/corosync/authkey): No such file or directory 2025-10-02T02:36:10.267081019+00:00 stderr F (lrmd_init_remote_tls_server) warning: A cluster connection will not be possible until the key is available 2025-10-02T02:36:10.267572004+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-02T02:36:10.267750479+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-02T02:36:10.267784990+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-02T02:36:10.267831122+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-02T02:36:10.267874693+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-02T02:36:10.267917204+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-02T02:36:10.267970167+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-02T02:36:10.268027378+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-02T02:36:10.268027378+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-02T02:36:14.851972173+00:00 stderr F (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler) 2025-10-02T02:36:14.851972173+00:00 stderr F (lrmd_exit) info: Terminating with 0 clients 2025-10-02T02:36:14.851972173+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-02T02:36:14.852440297+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-02T02:36:14.852471458+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-02T02:36:14.852516279+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-02T02:36:14.852526669+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-02T02:36:14.852558570+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-02T02:36:14.852585981+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-02T02:36:14.852611852+00:00 stderr F (qb_ipcs_us_withdraw) info: withdrawing server sockets 2025-10-02T02:36:14.852687614+00:00 stderr F (crm_exit) info: Exiting pacemaker-remoted | with status 0 2025-10-02T02:36:15.527550756+00:00 stderr F + sudo -E kolla_set_configs 2025-10-02T02:36:15.538140959+00:00 stderr F sudo: unable to send audit message: Operation not permitted 2025-10-02T02:36:15.581477869+00:00 stderr F INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json 2025-10-02T02:36:15.581477869+00:00 stderr F INFO:__main__:Validating config file 2025-10-02T02:36:15.581477869+00:00 stderr F INFO:__main__:Kolla config strategy set to: COPY_ALWAYS 2025-10-02T02:36:15.581477869+00:00 stderr F INFO:__main__:Copying service configuration files 2025-10-02T02:36:15.581477869+00:00 stderr F INFO:__main__:Copying /dev/null to /etc/libqb/force-filesystem-sockets 2025-10-02T02:36:15.581477869+00:00 stderr F INFO:__main__:Setting permission for /etc/libqb/force-filesystem-sockets 2025-10-02T02:36:15.581477869+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/security/limits.d/redis.conf to /etc/security/limits.d/redis.conf 2025-10-02T02:36:15.581477869+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf to /etc/redis.conf 2025-10-02T02:36:15.581658854+00:00 stderr F INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/redis.conf.puppet to /etc/redis.conf.puppet 2025-10-02T02:36:15.581826929+00:00 stderr F INFO:__main__:Writing out command to execute 2025-10-02T02:36:15.582114868+00:00 stderr F INFO:__main__:Setting permission for /run/redis 2025-10-02T02:36:15.582114868+00:00 stderr F INFO:__main__:Setting permission for /var/lib/redis 2025-10-02T02:36:15.582164210+00:00 stderr F INFO:__main__:Setting permission for /var/log/redis 2025-10-02T02:36:15.588184174+00:00 stderr F ++ cat /run_command 2025-10-02T02:36:15.591092082+00:00 stdout F Running command: '/usr/sbin/pacemaker_remoted' 2025-10-02T02:36:15.591112793+00:00 stderr F + CMD=/usr/sbin/pacemaker_remoted 2025-10-02T02:36:15.591112793+00:00 stderr F + ARGS= 2025-10-02T02:36:15.591112793+00:00 stderr F + [[ ! -n '' ]] 2025-10-02T02:36:15.591112793+00:00 stderr F + . kolla_extend_start 2025-10-02T02:36:15.591112793+00:00 stderr F + echo 'Running command: '\''/usr/sbin/pacemaker_remoted'\''' 2025-10-02T02:36:15.591112793+00:00 stderr F + umask 0022 2025-10-02T02:36:15.591112793+00:00 stderr F + exec /usr/sbin/pacemaker_remoted 2025-10-02T02:36:15.600244801+00:00 stderr F (pcmk__add_logfile) warning: Logging to '/var/log/pacemaker/pacemaker.log' is disabled: No such file or directory | uid=0 gid=0 2025-10-02T02:36:15.601690705+00:00 stderr F (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores 2025-10-02T02:36:15.601843840+00:00 stderr F (main) notice: Starting Pacemaker remote executor 2025-10-02T02:36:15.601843840+00:00 stderr F (qb_ipcs_us_publish) info: server name: lrmd 2025-10-02T02:36:15.602335785+00:00 stderr F (pcmk__init_tls_dh) info: Generating Diffie-Hellman parameters with 2048-bit prime for TLS 2025-10-02T02:36:15.716527173+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_ro 2025-10-02T02:36:15.716570665+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_rw 2025-10-02T02:36:15.716624446+00:00 stderr F (qb_ipcs_us_publish) info: server name: cib_shm 2025-10-02T02:36:15.716678169+00:00 stderr F (qb_ipcs_us_publish) info: server name: attrd 2025-10-02T02:36:15.716727290+00:00 stderr F (qb_ipcs_us_publish) info: server name: stonith-ng 2025-10-02T02:36:15.716765392+00:00 stderr F (qb_ipcs_us_publish) info: server name: pacemakerd 2025-10-02T02:36:15.716802753+00:00 stderr F (qb_ipcs_us_publish) info: server name: crmd 2025-10-02T02:36:15.717079241+00:00 stderr F (main) notice: Pacemaker remote executor successfully started and accepting connections 2025-10-02T02:36:15.717079241+00:00 stderr F (main) notice: OCF resource agent search path is /usr/lib/ocf/resource.d 2025-10-02T02:36:16.246680927+00:00 stderr F (pcmk__accept_remote_connection) info: Accepted new remote client connection from ::ffff:172.17.0.100 2025-10-02T02:36:16.246828211+00:00 stderr F (lrmd_remote_listen) info: Remote client pending authentication | 0x565034dd7b00 id: 42345746-0130-4f7f-87d3-86c7bd742ae0 2025-10-02T02:36:16.791091234+00:00 stderr F (remoted__read_handshake_data) notice: Remote client connection accepted 2025-10-02T02:36:16.929005826+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis' not in cache 2025-10-02T02:36:16.969934653+00:00 stderr F (process_lrmd_get_rsc_info) info: Agent information for 'redis:0' not in cache 2025-10-02T02:36:17.052198919+00:00 stderr F (process_lrmd_rsc_register) info: Cached agent information for 'redis' 2025-10-02T02:36:17.459252192+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:8 2025-10-02T02:36:21.471713254+00:00 stderr F (log_op_output) info: redis_start_0[55] error output [ Schema validation of configuration is disabled (enabling is encouraged and prevents common misconfigurations) ] 2025-10-02T02:36:21.471713254+00:00 stderr F (log_finished) info: redis start (call 8, PID 55) exited with status 0 (execution time 4.012s) 2025-10-02T02:36:21.550290158+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:38 2025-10-02T02:36:21.623348994+00:00 stderr F (log_finished) info: redis notify (call 38, PID 217) exited with status 0 (execution time 73ms) 2025-10-02T02:36:21.721268868+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:39 2025-10-02T02:36:21.797101128+00:00 stderr F (log_finished) info: redis notify (call 39, PID 263) exited with status 0 (execution time 76ms) 2025-10-02T02:36:21.840252962+00:00 stderr F (log_execute) info: executing - rsc:redis action:promote call_id:40 2025-10-02T02:36:22.754268722+00:00 stderr F (log_finished) info: redis promote (call 40, PID 309) exited with status 0 (execution time 914ms) 2025-10-02T02:36:22.834320720+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:53 2025-10-02T02:36:23.159734875+00:00 stderr F (log_finished) info: redis notify (call 53, PID 382) exited with status 0 (execution time 325ms) 2025-10-02T03:43:09.943469706+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:980 2025-10-02T03:43:10.014955592+00:00 stderr F (log_finished) info: redis notify (call 980, PID 11985) exited with status 0 (execution time 72ms) 2025-10-02T03:43:10.056932335+00:00 stderr F (cancel_recurring_action) info: Cancelling ocf operation redis_monitor_20000 2025-10-02T03:43:10.139228721+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:982 2025-10-02T03:43:10.232197463+00:00 stderr F (log_finished) info: redis demote (call 982, PID 12031) exited with status 7 (execution time 93ms) 2025-10-02T03:43:10.277345403+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:983 2025-10-02T03:43:10.350491870+00:00 stderr F (log_finished) info: redis notify (call 983, PID 12093) exited with status 0 (execution time 73ms) 2025-10-02T03:43:10.449206678+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:984 2025-10-02T03:43:10.512546343+00:00 stderr F (log_finished) info: redis notify (call 984, PID 12139) exited with status 0 (execution time 63ms) 2025-10-02T03:43:10.555243049+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:985 2025-10-02T03:43:10.859503801+00:00 stderr F (log_finished) info: redis stop (call 985, PID 12185) exited with status 0 (execution time 305ms) 2025-10-02T03:43:11.073242476+00:00 stderr F (log_execute) info: executing - rsc:redis action:start call_id:991 2025-10-02T03:46:31.076668368+00:00 stderr F (async_action_complete) info: Resource agent redis_start_0[12238] timed out after 3m20s 2025-10-02T03:46:31.076668368+00:00 stderr F (log_finished) info: redis start (call 991, PID 12238) could not be executed: Timed Out (Resource agent did not complete within 3m20s) (execution time 3m20.002s) 2025-10-02T03:46:31.123166809+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:999 2025-10-02T03:46:31.198458480+00:00 stderr F (log_finished) info: redis notify (call 999, PID 12506) exited with status 0 (execution time 75ms) 2025-10-02T03:46:31.307261217+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:1000 2025-10-02T03:46:31.356739210+00:00 stderr F (log_finished) info: redis notify (call 1000, PID 12552) exited with status 0 (execution time 49ms) 2025-10-02T03:46:31.399004422+00:00 stderr F (log_execute) info: executing - rsc:redis action:demote call_id:1001 2025-10-02T03:46:31.463353889+00:00 stderr F (log_finished) info: redis demote (call 1001, PID 12598) exited with status 7 (execution time 64ms) 2025-10-02T03:46:31.510007855+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:1002 2025-10-02T03:46:31.568495083+00:00 stderr F (log_finished) info: redis notify (call 1002, PID 12660) exited with status 0 (execution time 58ms) 2025-10-02T03:46:31.676200956+00:00 stderr F (log_execute) info: executing - rsc:redis action:notify call_id:1003 2025-10-02T03:46:31.748320681+00:00 stderr F (log_finished) info: redis notify (call 1003, PID 12706) exited with status 0 (execution time 71ms) 2025-10-02T03:46:31.790197801+00:00 stderr F (log_execute) info: executing - rsc:redis action:stop call_id:1004 2025-10-02T03:46:32.107135051+00:00 stderr F (log_finished) info: redis stop (call 1004, PID 12752) exited with status 0 (execution time 317ms)