=ERROR REPORT==== 11-Oct-2025::10:53:42.092578 === inet_config: syntax error in /etc/rabbitmq/erl_inetrc =ERROR REPORT==== 11-Oct-2025::10:53:42.092578 === inet_config: syntax error in /etc/rabbitmq/erl_inetrc 2025-10-11 10:53:44.164116+00:00 [warning] <0.157.0> TLS distribution: unexpected message: {'EXIT',<0.156.0>,shutdown} 2025-10-11 10:53:44.164116+00:00 [warning] <0.157.0> 2025-10-11 10:53:45.932442+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:45.932503+00:00 [info] <0.250.0> Feature flags: [ ] implicit_default_bindings 2025-10-11 10:53:45.932520+00:00 [info] <0.250.0> Feature flags: [ ] maintenance_mode_status 2025-10-11 10:53:45.932532+00:00 [info] <0.250.0> Feature flags: [ ] quorum_queue 2025-10-11 10:53:45.932589+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:45.932600+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:45.932611+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:45.932655+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:46.479443+00:00 [notice] <0.44.0> Application syslog exited with reason: stopped 2025-10-11 10:53:46.479536+00:00 [notice] <0.250.0> Logging: switching to configured handler(s); following messages may not be visible in this log output 2025-10-11 10:53:46.498457+00:00 [notice] <0.250.0> Logging: configured log handlers are now ACTIVE 2025-10-11 10:53:46.853841+00:00 [info] <0.250.0> ra: starting system quorum_queues 2025-10-11 10:53:46.853930+00:00 [info] <0.250.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack/quorum/rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack 2025-10-11 10:53:46.956536+00:00 [info] <0.286.0> ra system 'quorum_queues' running pre init for 0 registered servers 2025-10-11 10:53:46.980476+00:00 [info] <0.287.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered 2025-10-11 10:53:46.999808+00:00 [notice] <0.292.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables 2025-10-11 10:53:47.015125+00:00 [info] <0.250.0> ra: starting system coordination 2025-10-11 10:53:47.015188+00:00 [info] <0.250.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack/coordination/rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack 2025-10-11 10:53:47.027867+00:00 [info] <0.299.0> ra system 'coordination' running pre init for 0 registered servers 2025-10-11 10:53:47.030092+00:00 [info] <0.300.0> ra: meta data store initialised for system coordination. 0 record(s) recovered 2025-10-11 10:53:47.030273+00:00 [notice] <0.305.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables 2025-10-11 10:53:47.036934+00:00 [info] <0.250.0>  2025-10-11 10:53:47.036934+00:00 [info] <0.250.0> Starting RabbitMQ 3.9.21 on Erlang 24.3.4.2 [jit] 2025-10-11 10:53:47.036934+00:00 [info] <0.250.0> Copyright (c) 2007-2022 VMware, Inc. or its affiliates. 2025-10-11 10:53:47.036934+00:00 [info] <0.250.0> Licensed under the MPL 2.0. Website: https://rabbitmq.com ## ## RabbitMQ 3.9.21 ## ## ########## Copyright (c) 2007-2022 VMware, Inc. or its affiliates. ###### ## ########## Licensed under the MPL 2.0. Website: https://rabbitmq.com Erlang: 24.3.4.2 [jit] TLS Library: OpenSSL - OpenSSL 3.5.1 1 Jul 2025 Doc guides: https://rabbitmq.com/documentation.html Support: https://rabbitmq.com/contact.html Tutorials: https://rabbitmq.com/getstarted.html Monitoring: https://rabbitmq.com/monitoring.html Logs: /var/lib/rabbitmq/rabbitmq_upgrade.log Config file(s): /etc/rabbitmq/advanced.config /etc/rabbitmq/conf.d/10-operatorDefaults.conf /etc/rabbitmq/conf.d/11-default_user.conf /etc/rabbitmq/conf.d/90-userDefinedConfiguration.conf Starting broker...2025-10-11 10:53:47.039975+00:00 [info] <0.250.0>  2025-10-11 10:53:47.039975+00:00 [info] <0.250.0> node : rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack 2025-10-11 10:53:47.039975+00:00 [info] <0.250.0> home dir : /var/lib/rabbitmq 2025-10-11 10:53:47.039975+00:00 [info] <0.250.0> config file(s) : /etc/rabbitmq/advanced.config 2025-10-11 10:53:47.039975+00:00 [info] <0.250.0> : /etc/rabbitmq/conf.d/10-operatorDefaults.conf 2025-10-11 10:53:47.039975+00:00 [info] <0.250.0> : /etc/rabbitmq/conf.d/11-default_user.conf 2025-10-11 10:53:47.039975+00:00 [info] <0.250.0> : /etc/rabbitmq/conf.d/90-userDefinedConfiguration.conf 2025-10-11 10:53:47.039975+00:00 [info] <0.250.0> cookie hash : 4ervU2rn7if45GXtXZuXkA== 2025-10-11 10:53:47.039975+00:00 [info] <0.250.0> log(s) : /var/lib/rabbitmq/rabbitmq_upgrade.log 2025-10-11 10:53:47.039975+00:00 [info] <0.250.0> :  2025-10-11 10:53:47.039975+00:00 [info] <0.250.0> database dir : /var/lib/rabbitmq/mnesia/rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack 2025-10-11 10:53:47.401776+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:47.401841+00:00 [info] <0.250.0> Feature flags: [ ] drop_unroutable_metric 2025-10-11 10:53:47.401868+00:00 [info] <0.250.0> Feature flags: [ ] empty_basic_get_metric 2025-10-11 10:53:47.401924+00:00 [info] <0.250.0> Feature flags: [ ] implicit_default_bindings 2025-10-11 10:53:47.401944+00:00 [info] <0.250.0> Feature flags: [ ] maintenance_mode_status 2025-10-11 10:53:47.401961+00:00 [info] <0.250.0> Feature flags: [ ] quorum_queue 2025-10-11 10:53:47.401973+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:47.402026+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:47.402039+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:47.402052+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:50.913999+00:00 [info] <0.250.0> Running boot step pre_boot defined by app rabbit 2025-10-11 10:53:50.914133+00:00 [info] <0.250.0> Running boot step rabbit_global_counters defined by app rabbit 2025-10-11 10:53:50.914490+00:00 [info] <0.250.0> Running boot step rabbit_osiris_metrics defined by app rabbit 2025-10-11 10:53:50.914641+00:00 [info] <0.250.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-10-11 10:53:50.916164+00:00 [info] <0.250.0> Running boot step rabbit_alarm defined by app rabbit 2025-10-11 10:53:50.933083+00:00 [info] <0.317.0> Memory high watermark set to 655 MiB (687194767 bytes) of 1638 MiB (1717986919 bytes) total 2025-10-11 10:53:50.944433+00:00 [info] <0.319.0> Enabling free disk space monitoring 2025-10-11 10:53:50.944540+00:00 [info] <0.319.0> Disk free limit set to 2000MB 2025-10-11 10:53:50.968721+00:00 [info] <0.250.0> Running boot step code_server_cache defined by app rabbit 2025-10-11 10:53:50.968892+00:00 [info] <0.250.0> Running boot step file_handle_cache defined by app rabbit 2025-10-11 10:53:50.969203+00:00 [info] <0.324.0> Limiting to approx 1048479 file handles (943629 sockets) 2025-10-11 10:53:50.969370+00:00 [info] <0.325.0> FHC read buffering: OFF 2025-10-11 10:53:50.969425+00:00 [info] <0.325.0> FHC write buffering: ON 2025-10-11 10:53:50.969972+00:00 [info] <0.250.0> Running boot step worker_pool defined by app rabbit 2025-10-11 10:53:50.970061+00:00 [info] <0.307.0> Will use 16 processes for default worker pool 2025-10-11 10:53:50.970103+00:00 [info] <0.307.0> Starting worker pool 'worker_pool' with 16 processes in it 2025-10-11 10:53:50.970971+00:00 [info] <0.250.0> Running boot step database defined by app rabbit 2025-10-11 10:53:50.971313+00:00 [info] <0.250.0> Node database directory at /var/lib/rabbitmq/mnesia/rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack is empty. Assuming we need to join an existing cluster or initialise from scratch... 2025-10-11 10:53:50.971387+00:00 [info] <0.250.0> Configured peer discovery backend: rabbit_peer_discovery_k8s 2025-10-11 10:53:50.971655+00:00 [info] <0.250.0> Will try to lock with peer discovery backend rabbit_peer_discovery_k8s 2025-10-11 10:53:50.973168+00:00 [warning] <0.344.0> Description: "Authenticity is not established by certificate path validation" 2025-10-11 10:53:50.973168+00:00 [warning] <0.344.0> Reason: "Option {verify, verify_peer} and cacertfile/cacerts is missing" 2025-10-11 10:53:50.973168+00:00 [warning] <0.344.0>  2025-10-11 10:53:51.013742+00:00 [info] <0.250.0> Will try to lock connecting to nodes ['rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack', 2025-10-11 10:53:51.013742+00:00 [info] <0.250.0> 'rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack', 2025-10-11 10:53:51.013742+00:00 [info] <0.250.0> 'rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack'] 2025-10-11 10:53:51.098919+00:00 [info] <0.250.0> All discovered existing cluster peers: rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack, rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack, rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack 2025-10-11 10:53:51.098991+00:00 [info] <0.250.0> Peer nodes we can cluster with: rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack, rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack 2025-10-11 10:53:51.102666+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:51.102666+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:51.109338+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:51.109338+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:51.109421+00:00 [info] <0.250.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2025-10-11 10:53:51.613722+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:51.613722+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:51.622490+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:51.622490+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:51.622726+00:00 [info] <0.250.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2025-10-11 10:53:52.125675+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:52.125675+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:52.127705+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:52.127705+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:52.127907+00:00 [info] <0.250.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2025-10-11 10:53:52.631994+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:52.631994+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:52.634348+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:52.634348+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:52.634572+00:00 [info] <0.250.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2025-10-11 10:53:53.139521+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:53.139521+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:53.141342+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:53.141342+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:53.141546+00:00 [info] <0.250.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2025-10-11 10:53:53.643568+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:53.643568+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:53.645196+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:53.645196+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:53.645436+00:00 [info] <0.250.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2025-10-11 10:53:54.147680+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:54.147680+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:54.163130+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:54.163130+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:54.163274+00:00 [info] <0.250.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2025-10-11 10:53:54.665675+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:54.665675+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:54.667525+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:54.667525+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:54.667668+00:00 [info] <0.250.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2025-10-11 10:53:55.170561+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:55.170561+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:55.172625+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:55.172625+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:55.172757+00:00 [info] <0.250.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2025-10-11 10:53:55.675512+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:55.675512+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:55.677410+00:00 [warning] <0.250.0> Could not auto-cluster with node rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack: {error, 2025-10-11 10:53:55.677410+00:00 [warning] <0.250.0> tables_not_present} 2025-10-11 10:53:55.677471+00:00 [info] <0.250.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2025-10-11 10:53:56.177796+00:00 [info] <0.250.0> Could not successfully contact any node of: rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack,rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack (as in Erlang distribution). Starting as a blank standalone node... 2025-10-11 10:53:56.181159+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped 2025-10-11 10:53:56.371274+00:00 [info] <0.250.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-10-11 10:53:56.371451+00:00 [info] <0.250.0> Successfully synced tables from a peer 2025-10-11 10:53:56.390050+00:00 [info] <0.250.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-10-11 10:53:56.390204+00:00 [info] <0.250.0> Successfully synced tables from a peer 2025-10-11 10:53:56.390245+00:00 [info] <0.250.0> Feature flag `drop_unroutable_metric`: supported, attempt to enable... 2025-10-11 10:53:56.391620+00:00 [info] <0.250.0> Feature flag `drop_unroutable_metric`: mark as enabled=state_changing 2025-10-11 10:53:56.393802+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.393847+00:00 [info] <0.250.0> Feature flags: [~] drop_unroutable_metric 2025-10-11 10:53:56.393954+00:00 [info] <0.250.0> Feature flags: [ ] empty_basic_get_metric 2025-10-11 10:53:56.393982+00:00 [info] <0.250.0> Feature flags: [ ] implicit_default_bindings 2025-10-11 10:53:56.394015+00:00 [info] <0.250.0> Feature flags: [ ] maintenance_mode_status 2025-10-11 10:53:56.394097+00:00 [info] <0.250.0> Feature flags: [ ] quorum_queue 2025-10-11 10:53:56.394118+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:56.394140+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.394157+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.394244+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.404063+00:00 [info] <0.250.0> Feature flag `drop_unroutable_metric`: mark as enabled=true 2025-10-11 10:53:56.406554+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.406654+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.406694+00:00 [info] <0.250.0> Feature flags: [ ] empty_basic_get_metric 2025-10-11 10:53:56.406861+00:00 [info] <0.250.0> Feature flags: [ ] implicit_default_bindings 2025-10-11 10:53:56.406920+00:00 [info] <0.250.0> Feature flags: [ ] maintenance_mode_status 2025-10-11 10:53:56.406951+00:00 [info] <0.250.0> Feature flags: [ ] quorum_queue 2025-10-11 10:53:56.406970+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:56.407007+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.407027+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.407047+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.418667+00:00 [info] <0.250.0> Feature flag `empty_basic_get_metric`: supported, attempt to enable... 2025-10-11 10:53:56.419625+00:00 [info] <0.250.0> Feature flag `empty_basic_get_metric`: mark as enabled=state_changing 2025-10-11 10:53:56.421473+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.421522+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.421569+00:00 [info] <0.250.0> Feature flags: [~] empty_basic_get_metric 2025-10-11 10:53:56.421590+00:00 [info] <0.250.0> Feature flags: [ ] implicit_default_bindings 2025-10-11 10:53:56.421612+00:00 [info] <0.250.0> Feature flags: [ ] maintenance_mode_status 2025-10-11 10:53:56.421633+00:00 [info] <0.250.0> Feature flags: [ ] quorum_queue 2025-10-11 10:53:56.421647+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:56.421669+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.421680+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.421698+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.432693+00:00 [info] <0.250.0> Feature flag `empty_basic_get_metric`: mark as enabled=true 2025-10-11 10:53:56.443143+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.443254+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.443306+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.443410+00:00 [info] <0.250.0> Feature flags: [ ] implicit_default_bindings 2025-10-11 10:53:56.443450+00:00 [info] <0.250.0> Feature flags: [ ] maintenance_mode_status 2025-10-11 10:53:56.443470+00:00 [info] <0.250.0> Feature flags: [ ] quorum_queue 2025-10-11 10:53:56.443488+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:56.443516+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.443535+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.443562+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.459748+00:00 [info] <0.250.0> Feature flag `implicit_default_bindings`: supported, attempt to enable... 2025-10-11 10:53:56.460587+00:00 [info] <0.250.0> Feature flag `implicit_default_bindings`: mark as enabled=state_changing 2025-10-11 10:53:56.462253+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.462307+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.462415+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.462441+00:00 [info] <0.250.0> Feature flags: [~] implicit_default_bindings 2025-10-11 10:53:56.462488+00:00 [info] <0.250.0> Feature flags: [ ] maintenance_mode_status 2025-10-11 10:53:56.462522+00:00 [info] <0.250.0> Feature flags: [ ] quorum_queue 2025-10-11 10:53:56.462540+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:56.462565+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.462583+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.462606+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.474946+00:00 [info] <0.250.0> Waiting for Mnesia tables for 30000 ms, 0 retries left 2025-10-11 10:53:56.475110+00:00 [info] <0.250.0> Successfully synced tables from a peer 2025-10-11 10:53:56.475173+00:00 [info] <0.250.0> Feature flag `implicit_default_bindings`: mark as enabled=true 2025-10-11 10:53:56.478552+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.478606+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.478652+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.478675+00:00 [info] <0.250.0> Feature flags: [x] implicit_default_bindings 2025-10-11 10:53:56.478704+00:00 [info] <0.250.0> Feature flags: [ ] maintenance_mode_status 2025-10-11 10:53:56.478722+00:00 [info] <0.250.0> Feature flags: [ ] quorum_queue 2025-10-11 10:53:56.478743+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:56.478770+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.478787+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.478805+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.491972+00:00 [info] <0.250.0> Feature flag `maintenance_mode_status`: supported, attempt to enable... 2025-10-11 10:53:56.492962+00:00 [info] <0.250.0> Feature flag `maintenance_mode_status`: mark as enabled=state_changing 2025-10-11 10:53:56.494192+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.494227+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.494260+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.494276+00:00 [info] <0.250.0> Feature flags: [x] implicit_default_bindings 2025-10-11 10:53:56.494301+00:00 [info] <0.250.0> Feature flags: [~] maintenance_mode_status 2025-10-11 10:53:56.494319+00:00 [info] <0.250.0> Feature flags: [ ] quorum_queue 2025-10-11 10:53:56.494331+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:56.494347+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.494378+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.494394+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.505093+00:00 [info] <0.250.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status` 2025-10-11 10:53:56.518540+00:00 [info] <0.250.0> Feature flag `maintenance_mode_status`: mark as enabled=true 2025-10-11 10:53:56.522544+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.522673+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.522724+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.522763+00:00 [info] <0.250.0> Feature flags: [x] implicit_default_bindings 2025-10-11 10:53:56.522785+00:00 [info] <0.250.0> Feature flags: [x] maintenance_mode_status 2025-10-11 10:53:56.522820+00:00 [info] <0.250.0> Feature flags: [ ] quorum_queue 2025-10-11 10:53:56.522860+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:56.522878+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.523231+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.523301+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.536155+00:00 [info] <0.250.0> Feature flag `quorum_queue`: supported, attempt to enable... 2025-10-11 10:53:56.537024+00:00 [info] <0.250.0> Feature flag `quorum_queue`: mark as enabled=state_changing 2025-10-11 10:53:56.538469+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.538521+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.538558+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.538584+00:00 [info] <0.250.0> Feature flags: [x] implicit_default_bindings 2025-10-11 10:53:56.538605+00:00 [info] <0.250.0> Feature flags: [x] maintenance_mode_status 2025-10-11 10:53:56.538629+00:00 [info] <0.250.0> Feature flags: [~] quorum_queue 2025-10-11 10:53:56.538653+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:56.538671+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.538689+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.538717+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.550412+00:00 [info] <0.250.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-10-11 10:53:56.550563+00:00 [info] <0.250.0> Successfully synced tables from a peer 2025-10-11 10:53:56.550603+00:00 [info] <0.250.0> Feature flag `quorum_queue`: migrating Mnesia table rabbit_queue... 2025-10-11 10:53:56.593873+00:00 [info] <0.250.0> Feature flag `quorum_queue`: migrating Mnesia table rabbit_durable_queue... 2025-10-11 10:53:56.619653+00:00 [info] <0.250.0> Feature flag `quorum_queue`: Mnesia tables migration done 2025-10-11 10:53:56.619789+00:00 [info] <0.250.0> Feature flag `quorum_queue`: mark as enabled=true 2025-10-11 10:53:56.622462+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.622543+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.622566+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.622618+00:00 [info] <0.250.0> Feature flags: [x] implicit_default_bindings 2025-10-11 10:53:56.622639+00:00 [info] <0.250.0> Feature flags: [x] maintenance_mode_status 2025-10-11 10:53:56.622664+00:00 [info] <0.250.0> Feature flags: [x] quorum_queue 2025-10-11 10:53:56.622734+00:00 [info] <0.250.0> Feature flags: [ ] stream_queue 2025-10-11 10:53:56.622754+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.622770+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.622798+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.633106+00:00 [info] <0.250.0> Feature flag `stream_queue`: supported, attempt to enable... 2025-10-11 10:53:56.633950+00:00 [info] <0.250.0> Feature flag `stream_queue`: mark as enabled=state_changing 2025-10-11 10:53:56.635417+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.635496+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.635520+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.635548+00:00 [info] <0.250.0> Feature flags: [x] implicit_default_bindings 2025-10-11 10:53:56.635606+00:00 [info] <0.250.0> Feature flags: [x] maintenance_mode_status 2025-10-11 10:53:56.635666+00:00 [info] <0.250.0> Feature flags: [x] quorum_queue 2025-10-11 10:53:56.635697+00:00 [info] <0.250.0> Feature flags: [~] stream_queue 2025-10-11 10:53:56.635743+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.635784+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.635806+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.644120+00:00 [info] <0.250.0> Feature flag `stream_queue`: mark as enabled=true 2025-10-11 10:53:56.646401+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.646475+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.646491+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.646511+00:00 [info] <0.250.0> Feature flags: [x] implicit_default_bindings 2025-10-11 10:53:56.646524+00:00 [info] <0.250.0> Feature flags: [x] maintenance_mode_status 2025-10-11 10:53:56.646536+00:00 [info] <0.250.0> Feature flags: [x] quorum_queue 2025-10-11 10:53:56.646567+00:00 [info] <0.250.0> Feature flags: [x] stream_queue 2025-10-11 10:53:56.646580+00:00 [info] <0.250.0> Feature flags: [ ] user_limits 2025-10-11 10:53:56.646591+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.646607+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.657261+00:00 [info] <0.250.0> Feature flag `user_limits`: supported, attempt to enable... 2025-10-11 10:53:56.658180+00:00 [info] <0.250.0> Feature flag `user_limits`: mark as enabled=state_changing 2025-10-11 10:53:56.660293+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.660413+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.660564+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.660615+00:00 [info] <0.250.0> Feature flags: [x] implicit_default_bindings 2025-10-11 10:53:56.660642+00:00 [info] <0.250.0> Feature flags: [x] maintenance_mode_status 2025-10-11 10:53:56.660670+00:00 [info] <0.250.0> Feature flags: [x] quorum_queue 2025-10-11 10:53:56.660686+00:00 [info] <0.250.0> Feature flags: [x] stream_queue 2025-10-11 10:53:56.660708+00:00 [info] <0.250.0> Feature flags: [~] user_limits 2025-10-11 10:53:56.660724+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.660746+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.670452+00:00 [info] <0.250.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-10-11 10:53:56.670704+00:00 [info] <0.250.0> Successfully synced tables from a peer 2025-10-11 10:53:56.700730+00:00 [info] <0.250.0> Feature flag `user_limits`: mark as enabled=true 2025-10-11 10:53:56.703632+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.703672+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.703691+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.703704+00:00 [info] <0.250.0> Feature flags: [x] implicit_default_bindings 2025-10-11 10:53:56.703744+00:00 [info] <0.250.0> Feature flags: [x] maintenance_mode_status 2025-10-11 10:53:56.703799+00:00 [info] <0.250.0> Feature flags: [x] quorum_queue 2025-10-11 10:53:56.703817+00:00 [info] <0.250.0> Feature flags: [x] stream_queue 2025-10-11 10:53:56.703837+00:00 [info] <0.250.0> Feature flags: [x] user_limits 2025-10-11 10:53:56.703851+00:00 [info] <0.250.0> Feature flags: [ ] virtual_host_metadata 2025-10-11 10:53:56.703891+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.716247+00:00 [info] <0.250.0> Feature flag `virtual_host_metadata`: supported, attempt to enable... 2025-10-11 10:53:56.717338+00:00 [info] <0.250.0> Feature flag `virtual_host_metadata`: mark as enabled=state_changing 2025-10-11 10:53:56.719692+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.719823+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.719869+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.719919+00:00 [info] <0.250.0> Feature flags: [x] implicit_default_bindings 2025-10-11 10:53:56.719962+00:00 [info] <0.250.0> Feature flags: [x] maintenance_mode_status 2025-10-11 10:53:56.720015+00:00 [info] <0.250.0> Feature flags: [x] quorum_queue 2025-10-11 10:53:56.720054+00:00 [info] <0.250.0> Feature flags: [x] stream_queue 2025-10-11 10:53:56.720083+00:00 [info] <0.250.0> Feature flags: [x] user_limits 2025-10-11 10:53:56.720112+00:00 [info] <0.250.0> Feature flags: [~] virtual_host_metadata 2025-10-11 10:53:56.720154+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.736737+00:00 [info] <0.250.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-10-11 10:53:56.736857+00:00 [info] <0.250.0> Successfully synced tables from a peer 2025-10-11 10:53:56.766718+00:00 [info] <0.250.0> Feature flag `virtual_host_metadata`: mark as enabled=true 2025-10-11 10:53:56.770155+00:00 [info] <0.250.0> Feature flags: list of feature flags found: 2025-10-11 10:53:56.770207+00:00 [info] <0.250.0> Feature flags: [x] drop_unroutable_metric 2025-10-11 10:53:56.770232+00:00 [info] <0.250.0> Feature flags: [x] empty_basic_get_metric 2025-10-11 10:53:56.770282+00:00 [info] <0.250.0> Feature flags: [x] implicit_default_bindings 2025-10-11 10:53:56.770302+00:00 [info] <0.250.0> Feature flags: [x] maintenance_mode_status 2025-10-11 10:53:56.770320+00:00 [info] <0.250.0> Feature flags: [x] quorum_queue 2025-10-11 10:53:56.770441+00:00 [info] <0.250.0> Feature flags: [x] stream_queue 2025-10-11 10:53:56.770465+00:00 [info] <0.250.0> Feature flags: [x] user_limits 2025-10-11 10:53:56.770483+00:00 [info] <0.250.0> Feature flags: [x] virtual_host_metadata 2025-10-11 10:53:56.770505+00:00 [info] <0.250.0> Feature flags: feature flag states written to disk: yes 2025-10-11 10:53:56.781593+00:00 [info] <0.250.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-10-11 10:53:56.782130+00:00 [info] <0.250.0> Successfully synced tables from a peer 2025-10-11 10:53:56.803058+00:00 [info] <0.250.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-10-11 10:53:56.803232+00:00 [info] <0.250.0> Successfully synced tables from a peer 2025-10-11 10:53:56.803254+00:00 [info] <0.250.0> Will register with peer discovery backend rabbit_peer_discovery_k8s 2025-10-11 10:53:56.854948+00:00 [info] <0.250.0> Will try to unlock with peer discovery backend rabbit_peer_discovery_k8s 2025-10-11 10:53:56.856445+00:00 [info] <0.250.0> Running boot step database_sync defined by app rabbit 2025-10-11 10:53:56.856699+00:00 [info] <0.250.0> Running boot step feature_flags defined by app rabbit 2025-10-11 10:53:56.856996+00:00 [info] <0.250.0> Running boot step codec_correctness_check defined by app rabbit 2025-10-11 10:53:56.857042+00:00 [info] <0.250.0> Running boot step external_infrastructure defined by app rabbit 2025-10-11 10:53:56.857069+00:00 [info] <0.250.0> Running boot step rabbit_registry defined by app rabbit 2025-10-11 10:53:56.857157+00:00 [info] <0.250.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-10-11 10:53:56.857265+00:00 [info] <0.250.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-10-11 10:53:56.857392+00:00 [info] <0.250.0> Running boot step rabbit_event defined by app rabbit 2025-10-11 10:53:56.857598+00:00 [info] <0.250.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-10-11 10:53:56.857711+00:00 [info] <0.250.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-10-11 10:53:56.857760+00:00 [info] <0.250.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-10-11 10:53:56.857812+00:00 [info] <0.250.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-10-11 10:53:56.857858+00:00 [info] <0.250.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-10-11 10:53:56.857918+00:00 [info] <0.250.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-10-11 10:53:56.857988+00:00 [info] <0.250.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-10-11 10:53:56.858084+00:00 [info] <0.250.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-10-11 10:53:56.858141+00:00 [info] <0.250.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-10-11 10:53:56.858205+00:00 [info] <0.250.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-10-11 10:53:56.858239+00:00 [info] <0.250.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-10-11 10:53:56.858292+00:00 [info] <0.250.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-10-11 10:53:56.858403+00:00 [info] <0.250.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-10-11 10:53:56.858489+00:00 [info] <0.250.0> Running boot step kernel_ready defined by app rabbit 2025-10-11 10:53:56.858530+00:00 [info] <0.250.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-10-11 10:53:56.858652+00:00 [info] <0.250.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-10-11 10:53:56.861772+00:00 [info] <0.616.0> epmd monitor knows us, inter-node communication (distribution) port: 25672 2025-10-11 10:53:56.861957+00:00 [info] <0.250.0> Running boot step guid_generator defined by app rabbit 2025-10-11 10:53:56.869151+00:00 [info] <0.250.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-10-11 10:53:56.869464+00:00 [info] <0.620.0> Starting rabbit_node_monitor 2025-10-11 10:53:56.869632+00:00 [info] <0.250.0> Running boot step delegate_sup defined by app rabbit 2025-10-11 10:53:56.870177+00:00 [info] <0.250.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-10-11 10:53:56.870448+00:00 [info] <0.250.0> Running boot step core_initialized defined by app rabbit 2025-10-11 10:53:56.870485+00:00 [info] <0.250.0> Running boot step upgrade_queues defined by app rabbit 2025-10-11 10:53:56.882038+00:00 [info] <0.250.0> message_store upgrades: 1 to apply 2025-10-11 10:53:56.882214+00:00 [info] <0.250.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2025-10-11 10:53:56.882449+00:00 [info] <0.250.0> message_store upgrades: No durable queues found. Skipping message store migration 2025-10-11 10:53:56.882513+00:00 [info] <0.250.0> message_store upgrades: Removing the old message store data 2025-10-11 10:53:56.883700+00:00 [info] <0.250.0> message_store upgrades: All upgrades applied successfully 2025-10-11 10:53:56.898930+00:00 [info] <0.250.0> Running boot step channel_tracking defined by app rabbit 2025-10-11 10:53:56.908032+00:00 [info] <0.250.0> Setting up a table for channel tracking on this node: 'tracked_channel_on_node_rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack' 2025-10-11 10:53:56.915135+00:00 [info] <0.250.0> Setting up a table for channel tracking on this node: 'tracked_channel_table_per_user_on_node_rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack' 2025-10-11 10:53:56.915475+00:00 [info] <0.250.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit 2025-10-11 10:53:56.915576+00:00 [info] <0.250.0> Running boot step connection_tracking defined by app rabbit 2025-10-11 10:53:56.923034+00:00 [info] <0.250.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack' 2025-10-11 10:53:56.930731+00:00 [info] <0.250.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack' 2025-10-11 10:53:56.948349+00:00 [info] <0.250.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack' 2025-10-11 10:53:56.948789+00:00 [info] <0.250.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-10-11 10:53:56.948878+00:00 [info] <0.250.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-10-11 10:53:56.949053+00:00 [info] <0.250.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-10-11 10:53:56.949369+00:00 [info] <0.250.0> Running boot step rabbit_policies defined by app rabbit 2025-10-11 10:53:56.949759+00:00 [info] <0.250.0> Running boot step rabbit_policy defined by app rabbit 2025-10-11 10:53:56.949812+00:00 [info] <0.250.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-10-11 10:53:56.949854+00:00 [info] <0.250.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit 2025-10-11 10:53:56.949924+00:00 [info] <0.250.0> Running boot step rabbit_stream_coordinator defined by app rabbit 2025-10-11 10:53:56.950145+00:00 [info] <0.250.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-10-11 10:53:56.950237+00:00 [info] <0.250.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-10-11 10:53:56.950304+00:00 [info] <0.250.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-10-11 10:53:56.950345+00:00 [info] <0.250.0> Management plugin: using rates mode 'basic' 2025-10-11 10:53:56.950801+00:00 [info] <0.250.0> Running boot step recovery defined by app rabbit 2025-10-11 10:53:56.952210+00:00 [info] <0.250.0> Running boot step empty_db_check defined by app rabbit 2025-10-11 10:53:56.952335+00:00 [info] <0.250.0> Will seed default virtual host and user... 2025-10-11 10:53:56.952516+00:00 [info] <0.250.0> Adding vhost '/' (description: 'Default virtual host', tags: []) 2025-10-11 10:53:57.008313+00:00 [info] <0.681.0> Making sure data directory '/var/lib/rabbitmq/mnesia/rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-10-11 10:53:57.021275+00:00 [info] <0.681.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048' 2025-10-11 10:53:57.026555+00:00 [info] <0.681.0> Starting message stores for vhost '/' 2025-10-11 10:53:57.026753+00:00 [info] <0.685.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-10-11 10:53:57.031083+00:00 [info] <0.681.0> Started message store of type transient for vhost '/' 2025-10-11 10:53:57.031327+00:00 [info] <0.689.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-10-11 10:53:57.034868+00:00 [warning] <0.689.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2025-10-11 10:53:57.038472+00:00 [info] <0.681.0> Started message store of type persistent for vhost '/' 2025-10-11 10:53:57.038623+00:00 [info] <0.681.0> Recovering 0 queues of type rabbit_classic_queue took 16ms 2025-10-11 10:53:57.038666+00:00 [info] <0.681.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms 2025-10-11 10:53:57.038698+00:00 [info] <0.681.0> Recovering 0 queues of type rabbit_stream_queue took 0ms 2025-10-11 10:53:57.045150+00:00 [info] <0.250.0> Created user 'default_user_Ih8CBxepTS8DcAgFqxu' 2025-10-11 10:53:57.049190+00:00 [info] <0.250.0> Successfully set user tags for user 'default_user_Ih8CBxepTS8DcAgFqxu' to [administrator] 2025-10-11 10:53:57.054981+00:00 [info] <0.250.0> Successfully set permissions for 'default_user_Ih8CBxepTS8DcAgFqxu' in virtual host '/' to '.*', '.*', '.*' 2025-10-11 10:53:57.055054+00:00 [info] <0.250.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-10-11 10:53:57.055078+00:00 [info] <0.250.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-10-11 10:53:57.055220+00:00 [info] <0.250.0> Running boot step background_gc defined by app rabbit 2025-10-11 10:53:57.055393+00:00 [info] <0.250.0> Running boot step routing_ready defined by app rabbit 2025-10-11 10:53:57.055421+00:00 [info] <0.250.0> Running boot step pre_flight defined by app rabbit 2025-10-11 10:53:57.055435+00:00 [info] <0.250.0> Running boot step notify_cluster defined by app rabbit 2025-10-11 10:53:57.055460+00:00 [info] <0.250.0> Running boot step networking defined by app rabbit 2025-10-11 10:53:57.055499+00:00 [info] <0.250.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit 2025-10-11 10:53:57.055515+00:00 [info] <0.250.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status` 2025-10-11 10:53:57.055659+00:00 [info] <0.250.0> Running boot step definition_import_worker_pool defined by app rabbit 2025-10-11 10:53:57.055698+00:00 [info] <0.307.0> Starting worker pool 'definition_import_pool' with 16 processes in it 2025-10-11 10:53:57.056609+00:00 [info] <0.250.0> Running boot step cluster_name defined by app rabbit 2025-10-11 10:53:57.056689+00:00 [info] <0.250.0> Initialising internal cluster ID to 'rabbitmq-cluster-id-1xYr2v3m56rff5lGYkNp9A' 2025-10-11 10:53:57.063054+00:00 [info] <0.250.0> Setting cluster name to 'rabbitmq-cell1' as configured 2025-10-11 10:53:57.067073+00:00 [info] <0.250.0> Running boot step direct_client defined by app rabbit 2025-10-11 10:53:57.067227+00:00 [info] <0.250.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management 2025-10-11 10:53:57.067346+00:00 [info] <0.736.0> Resetting node maintenance status 2025-10-11 10:53:57.087133+00:00 [info] <0.795.0> Management plugin: HTTP (non-TLS) listener started on port 15672 2025-10-11 10:53:57.099508+00:00 [info] <0.795.0> Management plugin: HTTPS listener started on port 15671 2025-10-11 10:53:57.099805+00:00 [info] <0.850.0> Statistics database started. 2025-10-11 10:53:57.099908+00:00 [info] <0.849.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-10-11 10:53:57.110245+00:00 [info] <0.866.0> Peer discovery: node cleanup is disabled 2025-10-11 10:53:57.117435+00:00 [info] <0.874.0> Prometheus metrics: HTTP (non-TLS) listener started on port 15692 2025-10-11 10:53:57.122828+00:00 [info] <0.874.0> Prometheus metrics: HTTPS listener started on port 15691 2025-10-11 10:53:57.123083+00:00 [info] <0.736.0> Ready to start client connection listeners 2025-10-11 10:53:57.134628+00:00 [info] <0.947.0> started TLS (SSL) listener on [::]:5671 completed with 6 plugins. 2025-10-11 10:53:57.241302+00:00 [info] <0.736.0> Server startup complete; 6 plugins started. 2025-10-11 10:53:57.241302+00:00 [info] <0.736.0> * rabbitmq_prometheus 2025-10-11 10:53:57.241302+00:00 [info] <0.736.0> * rabbitmq_peer_discovery_k8s 2025-10-11 10:53:57.241302+00:00 [info] <0.736.0> * rabbitmq_peer_discovery_common 2025-10-11 10:53:57.241302+00:00 [info] <0.736.0> * rabbitmq_management 2025-10-11 10:53:57.241302+00:00 [info] <0.736.0> * rabbitmq_web_dispatch 2025-10-11 10:53:57.241302+00:00 [info] <0.736.0> * rabbitmq_management_agent 2025-10-11 10:53:58.353596+00:00 [info] <0.620.0> rabbit on node 'rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack' up 2025-10-11 10:54:03.453239+00:00 [info] <0.620.0> rabbit on node 'rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack' up 2025-10-11 10:56:44.560731+00:00 [info] <0.1486.0> accepting AMQP connection <0.1486.0> (10.129.0.156:46682 -> 10.129.0.107:5671) 2025-10-11 10:56:44.563452+00:00 [info] <0.1486.0> Connection <0.1486.0> (10.129.0.156:46682 -> 10.129.0.107:5671) has a client-provided name: nova-compute:1:62792520-db33-42ad-80be-d5183a5f462e 2025-10-11 10:56:44.566104+00:00 [info] <0.1486.0> connection <0.1486.0> (10.129.0.156:46682 -> 10.129.0.107:5671 - nova-compute:1:62792520-db33-42ad-80be-d5183a5f462e): user 'default_user_Ih8CBxepTS8DcAgFqxu' authenticated and granted access to vhost '/' 2025-10-11 10:56:44.601533+00:00 [info] <0.1507.0> accepting AMQP connection <0.1507.0> (10.129.0.156:46696 -> 10.129.0.107:5671) 2025-10-11 10:56:44.603301+00:00 [info] <0.1507.0> Connection <0.1507.0> (10.129.0.156:46696 -> 10.129.0.107:5671) has a client-provided name: nova-compute:1:5063a20d-99b5-4328-bde9-0b3d19efa1e5 2025-10-11 10:56:44.605304+00:00 [info] <0.1507.0> connection <0.1507.0> (10.129.0.156:46696 -> 10.129.0.107:5671 - nova-compute:1:5063a20d-99b5-4328-bde9-0b3d19efa1e5): user 'default_user_Ih8CBxepTS8DcAgFqxu' authenticated and granted access to vhost '/' 2025-10-11 10:56:52.692251+00:00 [info] <0.1525.0> queue 'conductor' in vhost '/': leader call - leader not known. Command will be forwarded once leader is known. 2025-10-11 10:56:52.720792+00:00 [info] <0.1525.0> queue 'conductor' in vhost '/': granting vote for {'%2F_conductor','rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack'} with last indexterm {0,0} for term 1 previous term was 0 2025-10-11 10:56:52.729724+00:00 [info] <0.1525.0> queue 'conductor' in vhost '/': detected a new leader {'%2F_conductor','rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack'} in term 1 2025-10-11 10:56:52.866502+00:00 [info] <0.1533.0> queue 'conductor.nova-cell1-conductor-0' in vhost '/': leader call - leader not known. Command will be forwarded once leader is known. 2025-10-11 10:56:52.888849+00:00 [info] <0.1533.0> queue 'conductor.nova-cell1-conductor-0' in vhost '/': granting vote for {'%2F_conductor.nova-cell1-conductor-0','rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack'} with last indexterm {0,0} for term 1 previous term was 0 2025-10-11 10:56:52.899451+00:00 [info] <0.1533.0> queue 'conductor.nova-cell1-conductor-0' in vhost '/': detected a new leader {'%2F_conductor.nova-cell1-conductor-0','rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack'} in term 1 2025-10-11 10:56:56.170388+00:00 [info] <0.1550.0> accepting AMQP connection <0.1550.0> (10.129.0.156:57522 -> 10.129.0.107:5671) 2025-10-11 10:56:56.171726+00:00 [info] <0.1550.0> Connection <0.1550.0> (10.129.0.156:57522 -> 10.129.0.107:5671) has a client-provided name: nova-compute:1:d91951ed-7ad7-45fd-8977-7e450dbccc7d 2025-10-11 10:56:56.173165+00:00 [info] <0.1550.0> connection <0.1550.0> (10.129.0.156:57522 -> 10.129.0.107:5671 - nova-compute:1:d91951ed-7ad7-45fd-8977-7e450dbccc7d): user 'default_user_Ih8CBxepTS8DcAgFqxu' authenticated and granted access to vhost '/' 2025-10-11 10:56:56.243994+00:00 [notice] <0.1566.0> queue 'compute' in vhost '/': candidate -> leader in term: 1 machine version: 1 2025-10-11 10:56:56.250185+00:00 [info] <0.1559.0> ra: started cluster %2F_compute with 3 servers 2025-10-11 10:56:56.250185+00:00 [info] <0.1559.0> 0 servers failed to start: [] 2025-10-11 10:56:56.250185+00:00 [info] <0.1559.0> Leader: {'%2F_compute','rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack'} 2025-10-11 10:56:56.339784+00:00 [notice] <0.1598.0> queue 'compute.nova-cell1-compute-ironic-compute-0' in vhost '/': candidate -> leader in term: 1 machine version: 1 2025-10-11 10:56:56.341142+00:00 [info] <0.1559.0> ra: started cluster %2F_compute.nova-cell1-compute-ironic-compute-0 with 3 servers 2025-10-11 10:56:56.341142+00:00 [info] <0.1559.0> 0 servers failed to start: [] 2025-10-11 10:56:56.341142+00:00 [info] <0.1559.0> Leader: {'%2F_compute.nova-cell1-compute-ironic-compute-0','rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack'} 2025-10-11 11:28:03.417573+00:00 [info] <0.8663.0> accepting AMQP connection <0.8663.0> (100.64.0.3:47804 -> 10.129.0.107:5671) 2025-10-11 11:28:03.419600+00:00 [info] <0.8663.0> Connection <0.8663.0> (100.64.0.3:47804 -> 10.129.0.107:5671) has a client-provided name: nova-compute:2:8c3952f5-f219-4f35-94f0-3b6b9a1bd567 2025-10-11 11:28:03.421345+00:00 [info] <0.8663.0> connection <0.8663.0> (100.64.0.3:47804 -> 10.129.0.107:5671 - nova-compute:2:8c3952f5-f219-4f35-94f0-3b6b9a1bd567): user 'default_user_Ih8CBxepTS8DcAgFqxu' authenticated and granted access to vhost '/' 2025-10-11 11:28:03.584715+00:00 [info] <0.8688.0> accepting AMQP connection <0.8688.0> (100.64.0.3:48068 -> 10.129.0.107:5671) 2025-10-11 11:28:03.587444+00:00 [info] <0.8688.0> Connection <0.8688.0> (100.64.0.3:48068 -> 10.129.0.107:5671) has a client-provided name: nova-compute:2:b0797d64-8bcd-4c78-ab3a-8a19a825235a 2025-10-11 11:28:03.589837+00:00 [info] <0.8688.0> connection <0.8688.0> (100.64.0.3:48068 -> 10.129.0.107:5671 - nova-compute:2:b0797d64-8bcd-4c78-ab3a-8a19a825235a): user 'default_user_Ih8CBxepTS8DcAgFqxu' authenticated and granted access to vhost '/' 2025-10-11 11:28:06.166070+00:00 [warning] <0.8688.0> closing AMQP connection <0.8688.0> (100.64.0.3:48068 -> 10.129.0.107:5671 - nova-compute:2:b0797d64-8bcd-4c78-ab3a-8a19a825235a, vhost: '/', user: 'default_user_Ih8CBxepTS8DcAgFqxu'): 2025-10-11 11:28:06.166070+00:00 [warning] <0.8688.0> client unexpectedly closed TCP connection 2025-10-11 11:28:06.226739+00:00 [warning] <0.8663.0> closing AMQP connection <0.8663.0> (100.64.0.3:47804 -> 10.129.0.107:5671 - nova-compute:2:8c3952f5-f219-4f35-94f0-3b6b9a1bd567, vhost: '/', user: 'default_user_Ih8CBxepTS8DcAgFqxu'): 2025-10-11 11:28:06.226739+00:00 [warning] <0.8663.0> client unexpectedly closed TCP connection 2025-10-11 11:28:10.234504+00:00 [info] <0.8741.0> accepting AMQP connection <0.8741.0> (100.64.0.3:48000 -> 10.129.0.107:5671) 2025-10-11 11:28:10.237577+00:00 [info] <0.8741.0> Connection <0.8741.0> (100.64.0.3:48000 -> 10.129.0.107:5671) has a client-provided name: nova-compute:2:c644b24c-92ac-4db4-8480-32f6fc1b1312 2025-10-11 11:28:10.240516+00:00 [info] <0.8741.0> connection <0.8741.0> (100.64.0.3:48000 -> 10.129.0.107:5671 - nova-compute:2:c644b24c-92ac-4db4-8480-32f6fc1b1312): user 'default_user_Ih8CBxepTS8DcAgFqxu' authenticated and granted access to vhost '/' 2025-10-11 11:28:10.333806+00:00 [info] <0.8767.0> accepting AMQP connection <0.8767.0> (100.64.0.3:50110 -> 10.129.0.107:5671) 2025-10-11 11:28:10.336019+00:00 [info] <0.8767.0> Connection <0.8767.0> (100.64.0.3:50110 -> 10.129.0.107:5671) has a client-provided name: nova-compute:2:29dec502-dd51-4432-b8bf-a9b45a77dffc 2025-10-11 11:28:10.338201+00:00 [info] <0.8767.0> connection <0.8767.0> (100.64.0.3:50110 -> 10.129.0.107:5671 - nova-compute:2:29dec502-dd51-4432-b8bf-a9b45a77dffc): user 'default_user_Ih8CBxepTS8DcAgFqxu' authenticated and granted access to vhost '/' 2025-10-11 11:28:13.232550+00:00 [info] <0.8795.0> queue 'compute.edpm-compute-0.ctlplane.openstack.lab' in vhost '/': leader call - leader not known. Command will be forwarded once leader is known. 2025-10-11 11:28:13.256409+00:00 [info] <0.8795.0> queue 'compute.edpm-compute-0.ctlplane.openstack.lab' in vhost '/': granting vote for {'%2F_compute.edpm-compute-0.ctlplane.openstack.lab','rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack'} with last indexterm {0,0} for term 1 previous term was 0 2025-10-11 11:28:13.268385+00:00 [info] <0.8795.0> queue 'compute.edpm-compute-0.ctlplane.openstack.lab' in vhost '/': detected a new leader {'%2F_compute.edpm-compute-0.ctlplane.openstack.lab','rabbit@rabbitmq-cell1-server-1.rabbitmq-cell1-nodes.openstack'} in term 1 2025-10-11 11:28:13.443621+00:00 [info] <0.8806.0> queue 'compute.edpm-compute-1.ctlplane.openstack.lab' in vhost '/': leader call - leader not known. Command will be forwarded once leader is known. 2025-10-11 11:28:13.464565+00:00 [info] <0.8806.0> queue 'compute.edpm-compute-1.ctlplane.openstack.lab' in vhost '/': granting vote for {'%2F_compute.edpm-compute-1.ctlplane.openstack.lab','rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack'} with last indexterm {0,0} for term 1 previous term was 0 2025-10-11 11:28:13.474788+00:00 [info] <0.8806.0> queue 'compute.edpm-compute-1.ctlplane.openstack.lab' in vhost '/': detected a new leader {'%2F_compute.edpm-compute-1.ctlplane.openstack.lab','rabbit@rabbitmq-cell1-server-2.rabbitmq-cell1-nodes.openstack'} in term 1