\nThe Keystone service is temporarily unavailable.\n\n", "code": "503 Service Unavailable", "title": "Service Unavailable"}: nova.exception.ResourceProviderAllocationRetrievalFailed: Failed to retrieve allocations for resource provider db8b39ad-af52-43e3-99e2-f3c431f03241: {"message": "The server is currently unavailable. Please try again at a later time.
\nThe Keystone service is temporarily unavailable.\n\n", "code": "503 Service Unavailable", "title": "Service Unavailable"}
2025-12-06 08:45:50.344 2 DEBUG nova.compute.resource_tracker [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Total usable vcpus: 8, total allocated vcpus: 1 _report_final_resource_view /usr/lib/python3.9/site-packages/nova/compute/resource_tracker.py:1056
2025-12-06 08:45:50.345 2 DEBUG nova.compute.resource_tracker [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Final resource view: name=np0005548798.ooo.test phys_ram=15738MB used_ram=1024MB phys_disk=399GB used_disk=2GB total_vcpus=8 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 08:45:50 up 1:58, 0 users, load average: 0.05, 0.10, 0.16\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_47835b89168945138751a4b216280589': '1', 'io_workload': '0'} _report_final_resource_view /usr/lib/python3.9/site-packages/nova/compute/resource_tracker.py:1065
2025-12-06 08:45:50.394 2 ERROR nova.scheduler.client.report [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] [req-56704604-0bb2-4641-9374-10d489bf94ac] Failed to retrieve resource provider tree from placement API for UUID db8b39ad-af52-43e3-99e2-f3c431f03241. Got 503: {"message": "The server is currently unavailable. Please try again at a later time.
\nThe Keystone service is temporarily unavailable.\n\n", "code": "503 Service Unavailable", "title": "Service Unavailable"}: nova.exception.ResourceProviderAllocationRetrievalFailed: Failed to retrieve allocations for resource provider db8b39ad-af52-43e3-99e2-f3c431f03241: {"message": "The server is currently unavailable. Please try again at a later time.
\nThe Keystone service is temporarily unavailable.\n\n", "code": "503 Service Unavailable", "title": "Service Unavailable"}
2025-12-06 08:46:51.242 2 DEBUG nova.compute.resource_tracker [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Total usable vcpus: 8, total allocated vcpus: 1 _report_final_resource_view /usr/lib/python3.9/site-packages/nova/compute/resource_tracker.py:1056
2025-12-06 08:46:51.242 2 DEBUG nova.compute.resource_tracker [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Final resource view: name=np0005548798.ooo.test phys_ram=15738MB used_ram=1024MB phys_disk=399GB used_disk=2GB total_vcpus=8 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 08:46:51 up 1:59, 0 users, load average: 0.02, 0.08, 0.14\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_47835b89168945138751a4b216280589': '1', 'io_workload': '0'} _report_final_resource_view /usr/lib/python3.9/site-packages/nova/compute/resource_tracker.py:1065
2025-12-06 08:46:51.293 2 ERROR nova.scheduler.client.report [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] [req-5dd23209-6534-49f4-b1a2-eda572a9dc04] Failed to retrieve resource provider tree from placement API for UUID db8b39ad-af52-43e3-99e2-f3c431f03241. Got 503: {"message": "The server is currently unavailable. Please try again at a later time.
The proxy server received an invalid
2025-12-06 08:47:46.067 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] response from an upstream server.
2025-12-06 08:47:46.067 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] The proxy server could not handle the request
\nThe Keystone service is temporarily unavailable.\n\n", "code": "503 Service Unavailable", "title": "Service Unavailable"}: nova.exception.ResourceProviderAllocationRetrievalFailed: Failed to retrieve allocations for resource provider db8b39ad-af52-43e3-99e2-f3c431f03241: {"message": "The server is currently unavailable. Please try again at a later time.
\nThe Keystone service is temporarily unavailable.\n\n", "code": "503 Service Unavailable", "title": "Service Unavailable"}
2025-12-06 08:47:51.179 2 DEBUG nova.compute.resource_tracker [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Total usable vcpus: 8, total allocated vcpus: 1 _report_final_resource_view /usr/lib/python3.9/site-packages/nova/compute/resource_tracker.py:1056
2025-12-06 08:47:51.179 2 DEBUG nova.compute.resource_tracker [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Final resource view: name=np0005548798.ooo.test phys_ram=15738MB used_ram=1024MB phys_disk=399GB used_disk=2GB total_vcpus=8 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 08:47:51 up 2:00, 0 users, load average: 0.04, 0.08, 0.14\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_47835b89168945138751a4b216280589': '1', 'io_workload': '0'} _report_final_resource_view /usr/lib/python3.9/site-packages/nova/compute/resource_tracker.py:1065
2025-12-06 08:47:51.225 2 ERROR nova.scheduler.client.report [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] [req-91edc45a-5c13-4139-bf5d-e7f942a81ad9] Failed to retrieve resource provider tree from placement API for UUID db8b39ad-af52-43e3-99e2-f3c431f03241. Got 503: {"message": "The server is currently unavailable. Please try again at a later time.
No server is available to handle this request.
_handle_fault_response /usr/lib/python3.9/site-packages/neutronclient/v2_0/client.py:258
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] An error occurred while refreshing the network cache.: neutronclient.common.exceptions.ServiceUnavailable:
503 Service Unavailable
No server is available to handle this request.
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] Traceback (most recent call last):
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 9593, in _heal_instance_info_cache
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] self._require_nw_info_update(context, instance):
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 9500, in _require_nw_info_update
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] ports = self.network_api.list_ports(context, **search_opts)
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/nova/network/neutron.py", line 1806, in list_ports
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] return get_client(context).list_ports(**search_opts)
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/nova/network/neutron.py", line 182, in wrapper
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] ret = obj(*args, **kwargs)
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 799, in list_ports
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] return self.list('ports', self.ports_path, retrieve_all,
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/nova/network/neutron.py", line 182, in wrapper
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] ret = obj(*args, **kwargs)
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 368, in list
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] for r in self._pagination(collection, path, **params):
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 383, in _pagination
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] res = self.get(path, params=params)
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/nova/network/neutron.py", line 182, in wrapper
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] ret = obj(*args, **kwargs)
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 352, in get
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] return self.retry_request("GET", action, body=body,
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/nova/network/neutron.py", line 182, in wrapper
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] ret = obj(*args, **kwargs)
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 329, in retry_request
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] return self.do_request(method, action, body=body,
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/nova/network/neutron.py", line 182, in wrapper
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] ret = obj(*args, **kwargs)
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 293, in do_request
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] self._handle_fault_response(status_code, replybody, resp)
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/nova/network/neutron.py", line 182, in wrapper
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] ret = obj(*args, **kwargs)
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 268, in _handle_fault_response
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] exception_handler_v20(status_code, error_body)
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] File "/usr/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] raise client_exc(message=error_message,
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] neutronclient.common.exceptions.ServiceUnavailable:
503 Service Unavailable
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93] No server is available to handle this request.
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93]
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93]
2025-12-06 08:48:42.578 2 ERROR nova.compute.manager [instance: a5070ada-6b60-4992-a1bf-9e83aaccac93]
2025-12-06 08:48:43.480 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:48:43.481 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:48:44.338 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:48:44.400 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:48:46.479 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:48:46.480 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:48:46.846 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:48:48.480 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:48:48.481 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python3.9/site-packages/nova/compute/manager.py:10147
2025-12-06 08:48:49.397 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:48:50.479 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:48:51.885 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:48:54.398 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:48:56.912 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:48:59.429 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:01.945 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:04.468 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:06.984 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:09.510 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:12.034 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:14.548 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:17.038 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:19.605 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:22.039 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:24.641 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:27.044 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:29.684 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:32.047 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:34.729 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:37.051 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:39.764 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:42.054 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:44.796 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:47.055 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:49.848 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager.update_available_resource: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 86d8bbf1f9244374ae829519b53e80ca
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10241, in update_available_resource
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task compute_nodes_in_db = self._get_compute_nodes_in_db(context,
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10288, in _get_compute_nodes_in_db
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task return objects.ComputeNodeList.get_all_by_host(context, self.host,
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 86d8bbf1f9244374ae829519b53e80ca
2025-12-06 08:49:50.487 2 ERROR oslo_service.periodic_task
2025-12-06 08:49:52.058 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:54.891 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:56.396 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:49:56.396 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:49:57.059 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:49:59.093 2 WARNING nova.servicegroup.drivers.db [-] Lost connection to nova-conductor for reporting service status.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID f5193baf7dec4aab8aab9dc9c3fbb469
2025-12-06 08:49:59.094 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 08:49:59.934 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:02.063 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:04.965 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:07.065 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:09.999 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:12.067 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:15.047 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:17.070 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:20.097 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:22.072 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:25.125 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:27.074 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:30.166 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:32.075 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:35.213 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:37.078 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:40.248 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:42.080 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:45.276 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:47.082 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:50.312 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:52.085 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:55.353 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._sync_scheduler_instance_info: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID f3719364d47b4d85b018bf6d3195cce3
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 2153, in _sync_scheduler_instance_info
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task instances = objects.InstanceList.get_by_host(context, self.host,
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID f3719364d47b4d85b018bf6d3195cce3
2025-12-06 08:50:56.405 2 ERROR oslo_service.periodic_task
2025-12-06 08:50:56.407 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:50:56.407 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python3.9/site-packages/nova/compute/manager.py:9530
2025-12-06 08:50:56.408 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python3.9/site-packages/nova/compute/manager.py:9534
2025-12-06 08:50:57.088 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:50:59.100 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 08:51:00.355 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:02.091 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:05.413 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:07.095 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:10.450 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:12.098 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:15.488 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:17.103 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:20.519 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:22.103 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:25.522 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:27.108 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:30.564 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:32.111 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:35.607 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:37.134 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:40.651 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:42.136 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:45.674 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:47.166 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:50.702 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:52.194 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:55.739 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._heal_instance_info_cache: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID e0d4ca8605b84dbdb6dba1101dec9bfe
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 9535, in _heal_instance_info_cache
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task db_instances = objects.InstanceList.get_by_host(
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID e0d4ca8605b84dbdb6dba1101dec9bfe
2025-12-06 08:51:56.416 2 ERROR oslo_service.periodic_task
2025-12-06 08:51:56.417 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:51:56.418 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:51:56.418 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:51:56.418 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:51:57.214 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:51:59.105 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.00 sec
2025-12-06 08:52:00.798 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:02.233 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:05.827 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:07.278 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:10.884 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:12.280 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:15.915 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:17.328 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:20.961 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:22.330 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:26.001 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:27.375 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:31.031 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:32.377 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:36.062 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:37.411 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:41.109 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:42.414 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:46.150 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:47.449 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:51.185 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:52.454 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:56.229 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._instance_usage_audit: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 01d305c1c5fb496784276327210e0eea
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 9784, in _instance_usage_audit
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task if objects.TaskLog.get(context, 'instance_usage_audit', begin, end,
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/objects/base.py", line 355, in wrapper
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task return fn.__get__(None, obj)(*args, **kwargs)
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 01d305c1c5fb496784276327210e0eea
2025-12-06 08:52:56.425 2 ERROR oslo_service.periodic_task
2025-12-06 08:52:56.427 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:52:56.428 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._sync_power_states run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:52:57.490 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:52:59.112 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 08:53:01.271 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:02.493 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:06.302 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:07.550 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:11.336 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:12.552 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:16.375 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:17.593 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:21.421 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:22.594 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:26.465 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:27.643 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:31.496 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:32.644 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:36.536 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:37.701 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:41.576 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:42.703 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:46.614 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:47.746 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:51.662 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:52.782 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._sync_power_states: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID e8e35127b7eb4372a9fbcbe9f800916c
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 9894, in _sync_power_states
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task db_instances = objects.InstanceList.get_by_host(context, self.host,
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID e8e35127b7eb4372a9fbcbe9f800916c
2025-12-06 08:53:56.434 2 ERROR oslo_service.periodic_task
2025-12-06 08:53:56.436 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:53:56.436 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python3.9/site-packages/nova/compute/manager.py:10147
2025-12-06 08:53:56.437 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:53:56.693 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:57.838 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:53:59.119 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 08:54:01.727 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:02.877 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:06.770 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:07.912 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:11.814 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:12.945 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:16.860 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:17.993 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:21.904 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:23.039 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:26.907 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:28.094 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:31.944 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:33.141 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:36.985 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:38.178 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:42.016 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:43.220 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:47.054 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:48.255 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:52.093 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:53.287 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager.update_available_resource: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID faf8c3477bb744fa90615f59a5c63193
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10241, in update_available_resource
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task compute_nodes_in_db = self._get_compute_nodes_in_db(context,
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10288, in _get_compute_nodes_in_db
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task return objects.ComputeNodeList.get_all_by_host(context, self.host,
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID faf8c3477bb744fa90615f59a5c63193
2025-12-06 08:54:56.443 2 ERROR oslo_service.periodic_task
2025-12-06 08:54:56.444 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:54:56.445 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Cleaning up deleted instances _run_pending_deletes /usr/lib/python3.9/site-packages/nova/compute/manager.py:10796
2025-12-06 08:54:57.123 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:58.327 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:54:59.125 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 08:55:02.157 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:03.356 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:07.159 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:08.401 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:12.200 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:13.436 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:17.238 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:18.461 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:22.280 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:23.498 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:27.322 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:28.542 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:32.365 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:33.576 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:37.395 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:38.618 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:42.435 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:43.676 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:47.480 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:48.715 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:52.526 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:53.755 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._run_pending_deletes: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID d1f10653d50a4d8988ef53ee21d534a4
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10803, in _run_pending_deletes
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task instances = objects.InstanceList.get_by_filters(
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID d1f10653d50a4d8988ef53ee21d534a4
2025-12-06 08:55:56.453 2 ERROR oslo_service.periodic_task
2025-12-06 08:55:56.455 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:55:56.455 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations /usr/lib/python3.9/site-packages/nova/compute/manager.py:10834
2025-12-06 08:55:57.559 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:58.793 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:55:59.131 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 08:56:02.593 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:03.840 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:07.628 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:08.865 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:12.687 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:13.913 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:17.716 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:18.954 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:22.743 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:23.984 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:27.781 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:29.015 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:32.783 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:34.045 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:37.825 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:39.091 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:42.827 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:44.129 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:47.866 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:49.164 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:52.868 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:54.211 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._cleanup_incomplete_migrations: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID eebeb7207cab49d89d0cfbf55de1cecb
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10837, in _cleanup_incomplete_migrations
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task migrations = objects.MigrationList.get_by_filters(context,
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID eebeb7207cab49d89d0cfbf55de1cecb
2025-12-06 08:56:56.461 2 ERROR oslo_service.periodic_task
2025-12-06 08:56:56.463 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:56:57.911 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:56:59.137 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 08:56:59.238 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:02.913 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:04.276 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:08.000 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:09.318 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:13.003 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:14.352 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:18.040 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:19.391 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:23.042 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:24.425 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:28.076 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:29.476 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:33.078 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:34.515 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:38.121 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:39.548 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:43.123 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:44.589 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:48.126 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:49.632 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:53.128 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:54.658 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._cleanup_expired_console_auth_tokens: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 984c3f280d3d4da49a9e3a105c9ef46d
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10933, in _cleanup_expired_console_auth_tokens
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task objects.ConsoleAuthToken.clean_expired_console_auths(context)
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 984c3f280d3d4da49a9e3a105c9ef46d
2025-12-06 08:57:56.468 2 ERROR oslo_service.periodic_task
2025-12-06 08:57:58.131 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:57:59.150 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 08:57:59.697 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:03.133 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:04.735 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:08.134 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:09.773 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:13.137 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:14.812 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:18.138 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:19.847 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:23.140 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:24.893 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:28.144 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:29.896 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:33.146 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:34.897 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:38.147 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:39.941 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:43.150 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:44.982 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:48.151 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:50.026 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:53.153 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:55.083 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:56.473 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:58:56.473 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:58:58.155 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:58:59.156 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 08:59:00.128 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:03.158 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:05.158 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:08.160 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:10.193 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:13.162 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:15.230 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:18.163 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:20.259 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:23.164 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:25.307 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:28.166 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:30.339 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:33.168 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:35.370 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:38.169 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:40.405 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:43.171 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:45.452 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:48.192 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:50.503 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:53.235 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:55.538 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._sync_scheduler_instance_info: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID d6b76d3af9d742cc9725cbe8729a791c
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 2153, in _sync_scheduler_instance_info
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task instances = objects.InstanceList.get_by_host(context, self.host,
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID d6b76d3af9d742cc9725cbe8729a791c
2025-12-06 08:59:56.478 2 ERROR oslo_service.periodic_task
2025-12-06 08:59:56.479 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 08:59:56.479 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python3.9/site-packages/nova/compute/manager.py:9530
2025-12-06 08:59:56.479 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python3.9/site-packages/nova/compute/manager.py:9534
2025-12-06 08:59:58.282 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 08:59:59.162 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 09:00:00.582 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:03.325 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:05.615 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:08.358 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:10.651 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:13.386 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:15.690 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:18.387 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:20.734 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:23.437 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:25.789 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:28.468 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:30.828 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:33.504 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:35.874 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:38.506 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:40.920 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:43.544 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:45.923 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:48.579 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:50.961 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:53.616 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:55.969 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._heal_instance_info_cache: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 0406dbe4bfa240c6960ca3392bba46f6
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 9535, in _heal_instance_info_cache
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task db_instances = objects.InstanceList.get_by_host(
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 0406dbe4bfa240c6960ca3392bba46f6
2025-12-06 09:00:56.485 2 ERROR oslo_service.periodic_task
2025-12-06 09:00:56.486 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._poll_rebooting_instances run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:00:56.486 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._poll_rescued_instances run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:00:56.486 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._poll_unconfirmed_resizes run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:00:56.486 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._instance_usage_audit run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:00:58.654 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:00:59.172 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 09:01:01.010 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:03.691 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:06.014 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:08.735 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:11.053 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:13.767 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:16.057 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:18.809 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:21.088 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:23.861 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:26.091 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:28.896 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:31.113 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:33.952 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:36.120 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:39.000 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:41.166 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:44.031 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:46.170 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:49.068 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:51.201 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:54.100 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:56.204 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._instance_usage_audit: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID cc001196c17649f9824b3be7e8540539
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 9784, in _instance_usage_audit
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task if objects.TaskLog.get(context, 'instance_usage_audit', begin, end,
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/objects/base.py", line 355, in wrapper
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task return fn.__get__(None, obj)(*args, **kwargs)
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID cc001196c17649f9824b3be7e8540539
2025-12-06 09:01:56.490 2 ERROR oslo_service.periodic_task
2025-12-06 09:01:56.492 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._poll_volume_usage run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:01:56.493 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._sync_power_states run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:01:59.136 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:01:59.178 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 09:02:01.312 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:04.165 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:06.313 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:09.199 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:11.345 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:14.231 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:16.348 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:19.267 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:21.382 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:24.301 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:26.383 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:29.344 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:31.421 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:34.393 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:36.422 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:39.426 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:41.459 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:44.464 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:46.462 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:49.504 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:51.510 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:54.534 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._sync_power_states: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID a8400472808e4af6b21ae3ee0b0bd1b7
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 9894, in _sync_power_states
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task db_instances = objects.InstanceList.get_by_host(context, self.host,
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID a8400472808e4af6b21ae3ee0b0bd1b7
2025-12-06 09:02:56.498 2 ERROR oslo_service.periodic_task
2025-12-06 09:02:56.499 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._reclaim_queued_deletes run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:02:56.500 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] CONF.reclaim_instance_interval <= 0, skipping... _reclaim_queued_deletes /usr/lib/python3.9/site-packages/nova/compute/manager.py:10147
2025-12-06 09:02:56.500 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager.update_available_resource run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:02:56.513 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:02:59.184 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 09:02:59.565 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:01.547 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:04.596 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:06.550 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:09.620 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:11.596 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:14.657 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:16.599 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:19.689 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:21.633 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:24.726 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:26.637 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:29.767 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:32.428 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:34.805 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:37.431 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:39.851 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:42.433 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:44.893 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:47.436 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:49.930 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:52.438 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:54.974 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager.update_available_resource: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID bf44378def144dfbb1bf8e83e2b1f08b
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10241, in update_available_resource
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task compute_nodes_in_db = self._get_compute_nodes_in_db(context,
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10288, in _get_compute_nodes_in_db
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task return objects.ComputeNodeList.get_all_by_host(context, self.host,
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID bf44378def144dfbb1bf8e83e2b1f08b
2025-12-06 09:03:56.509 2 ERROR oslo_service.periodic_task
2025-12-06 09:03:56.511 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._cleanup_running_deleted_instances run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:03:57.441 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:03:59.192 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 09:04:00.004 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:02.445 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:05.046 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:07.446 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:10.069 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:12.450 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:15.117 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:17.454 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:20.148 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:22.457 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:25.189 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:27.460 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:30.233 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:32.464 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:35.285 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:37.465 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:40.329 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:42.468 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:45.333 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:47.471 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:50.375 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:52.475 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:55.410 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._cleanup_running_deleted_instances: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID a47ff29dbc494d7dbe6175fa86c3f1f3
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10339, in _cleanup_running_deleted_instances
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task instances = self._running_deleted_instances(context)
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10394, in _running_deleted_instances
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task instances = self._get_instances_on_driver(context, filters)
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 656, in _get_instances_on_driver
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task local_instances = objects.InstanceList.get_by_filters(
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID a47ff29dbc494d7dbe6175fa86c3f1f3
2025-12-06 09:04:56.528 2 ERROR oslo_service.periodic_task
2025-12-06 09:04:56.530 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._run_pending_deletes run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:04:56.530 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Cleaning up deleted instances _run_pending_deletes /usr/lib/python3.9/site-packages/nova/compute/manager.py:10796
2025-12-06 09:04:57.478 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:04:59.197 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.00 sec
2025-12-06 09:05:00.456 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:02.480 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:05.496 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:07.484 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:10.531 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:12.486 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:15.579 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:17.488 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:20.582 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:22.492 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:25.620 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:27.494 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:30.623 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:32.496 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:35.658 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:37.500 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:40.663 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:42.502 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:45.707 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:47.505 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:50.711 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:52.508 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:55.714 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._run_pending_deletes: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 304015d0d08d41cbbd96cc042b183e73
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10803, in _run_pending_deletes
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task instances = objects.InstanceList.get_by_filters(
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 304015d0d08d41cbbd96cc042b183e73
2025-12-06 09:05:56.537 2 ERROR oslo_service.periodic_task
2025-12-06 09:05:56.539 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._cleanup_incomplete_migrations run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:05:56.539 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Cleaning up deleted instances with incomplete migration _cleanup_incomplete_migrations /usr/lib/python3.9/site-packages/nova/compute/manager.py:10834
2025-12-06 09:05:57.511 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:05:59.202 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.00 sec
2025-12-06 09:06:00.717 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:02.514 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:05.720 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:07.516 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:10.724 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:12.517 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:15.728 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:17.521 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:20.731 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:22.522 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:25.734 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:27.527 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:30.738 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:32.528 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:35.740 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:37.590 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:40.743 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:42.621 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:45.745 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:47.659 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:50.747 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:52.695 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:55.749 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._cleanup_incomplete_migrations: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID cc6acd4b293f40eeab763f0c70a6b8d1
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10837, in _cleanup_incomplete_migrations
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task migrations = objects.MigrationList.get_by_filters(context,
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID cc6acd4b293f40eeab763f0c70a6b8d1
2025-12-06 09:06:56.545 2 ERROR oslo_service.periodic_task
2025-12-06 09:06:56.546 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:06:57.740 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:06:59.209 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 09:07:00.750 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:02.791 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:05.753 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:07.830 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:10.754 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:12.879 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:15.756 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:17.931 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:20.759 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:22.967 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:25.763 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:28.010 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:30.766 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:33.058 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:35.769 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:38.108 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:40.772 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:43.139 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:45.774 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:48.173 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:50.776 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:53.208 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:55.779 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._cleanup_expired_console_auth_tokens: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID a0a89849ea2c4fb3ba331ce310950138
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 10933, in _cleanup_expired_console_auth_tokens
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task objects.ConsoleAuthToken.clean_expired_console_auths(context)
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID a0a89849ea2c4fb3ba331ce310950138
2025-12-06 09:07:56.552 2 ERROR oslo_service.periodic_task
2025-12-06 09:07:58.272 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:07:59.216 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 09:08:00.801 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:03.313 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:05.829 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:08.341 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:10.853 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:13.386 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:15.883 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:18.421 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:20.926 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:23.425 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:25.975 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:28.426 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:31.011 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:33.429 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:36.049 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:38.465 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:41.084 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:43.467 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:46.120 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:48.504 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:51.164 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:53.507 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:56.200 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:56.555 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._check_instance_build_time run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:08:56.556 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._sync_scheduler_instance_info run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:08:58.533 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:08:59.221 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 09:09:01.248 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:03.536 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:06.289 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:08.571 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:10.094 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer
2025-12-06 09:09:11.111 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:11.331 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:12.198 2 INFO oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] Reconnected to AMQP server on np0005548796.internalapi.ooo.test:5672 via [amqp] client with port 49234.
2025-12-06 09:09:13.573 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:15.746 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'
2025-12-06 09:09:15.748 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer
2025-12-06 09:09:16.251 2 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
2025-12-06 09:09:16.266 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:16.377 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:16.774 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:16.775 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:17.889 2 INFO oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] Reconnected to AMQP server on np0005548795.internalapi.ooo.test:5672 via [amqp] client with port 38086.
2025-12-06 09:09:17.896 2 INFO oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] Reconnected to AMQP server on np0005548795.internalapi.ooo.test:5672 via [amqp] client with port 38092.
2025-12-06 09:09:18.607 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:21.407 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:23.434 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'
2025-12-06 09:09:23.435 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'
2025-12-06 09:09:23.608 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:24.431 2 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
2025-12-06 09:09:24.480 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:24.489 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:24.490 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:24.490 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:24.499 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:25.516 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:25.517 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:25.534 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:25.553 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:25.568 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:26.459 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:26.544 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:26.545 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:28.575 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:28.576 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:28.591 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:28.606 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:28.622 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:28.626 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:29.602 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:29.603 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:30.628 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:30.629 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:31.344 2 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
2025-12-06 09:09:31.359 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:31.373 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:31.387 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:31.489 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:32.404 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:32.419 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:32.433 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:33.613 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:33.645 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:33.659 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:33.673 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:34.658 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:34.659 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:35.453 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:35.467 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:35.481 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:35.685 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:35.686 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:36.527 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:36.714 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:36.714 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:38.616 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:40.507 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:40.522 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:40.537 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:40.715 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:40.729 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:40.743 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:41.547 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:42.756 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:42.757 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:43.618 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:43.784 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:43.785 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:44.803 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:44.804 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:46.583 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:47.567 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:47.583 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:47.597 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:48.621 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:49.788 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:49.802 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:49.816 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:51.615 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:52.848 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:52.849 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:53.624 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:53.876 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:53.877 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:54.905 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:54.906 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Error during ComputeManager._sync_scheduler_instance_info: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 7efc2d2f03c04b16a0c3a29a7f66e261
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task return self._queues[msg_id].get(block=True, timeout=timeout)
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 322, in get
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task return waiter.wait()
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/queue.py", line 141, in wait
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task return get_hub().switch()
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/eventlet/hubs/hub.py", line 313, in switch
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task return self.greenlet.switch()
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task _queue.Empty
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task task(self, context)
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 2153, in _sync_scheduler_instance_info
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task instances = objects.InstanceList.get_by_host(context, self.host,
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions(
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions',
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 175, in call
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task self.transport._send(self.target, msg_ctxt, msg,
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message,
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in send
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 670, in _send
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task result = self._waiter.wait(msg_id, timeout,
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task message = self.waiters.get(msg_id, timeout=timeout)
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task raise oslo_messaging.MessagingTimeout(
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 7efc2d2f03c04b16a0c3a29a7f66e261
2025-12-06 09:09:56.562 2 ERROR oslo_service.periodic_task
2025-12-06 09:09:56.563 2 DEBUG oslo_service.periodic_task [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Running periodic task ComputeManager._heal_instance_info_cache run_periodic_tasks /usr/lib/python3.9/site-packages/oslo_service/periodic_task.py:210
2025-12-06 09:09:56.564 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python3.9/site-packages/nova/compute/manager.py:9530
2025-12-06 09:09:56.564 2 DEBUG nova.compute.manager [req-26f7aea5-69b7-47c3-82bf-af43406bc6d8 - - - - -] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python3.9/site-packages/nova/compute/manager.py:9534
2025-12-06 09:09:56.622 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:56.636 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:56.650 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 11.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:09:56.662 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:58.627 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:09:59.227 2 WARNING oslo.service.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.01 sec
2025-12-06 09:10:00.838 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:00.852 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:00.867 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:01.699 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:03.630 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:04.941 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:04.942 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:05.969 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:05.970 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:06.735 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:06.997 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:06.998 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:07.678 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:07.694 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:07.710 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 13.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:08.632 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:11.774 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:13.635 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:13.890 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:13.904 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:13.918 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:16.803 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:18.638 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:19.036 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:19.037 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:20.065 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:20.066 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:20.739 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:20.753 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:20.767 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 15.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:21.093 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:21.094 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:21.847 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:23.641 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:26.879 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:28.644 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:28.943 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:28.957 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:28.971 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:31.915 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:33.647 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:35.132 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:35.133 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:35.831 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:35.841 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:35.851 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 17.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:36.159 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:36.160 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:36.947 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:37.187 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:37.188 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:38.648 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:41.984 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:43.651 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:46.003 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:46.018 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:46.033 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:47.016 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:48.653 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:52.048 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:52.890 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:52.906 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:52.921 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 19.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:53.227 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:53.228 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:53.656 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:54.254 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:54.255 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:55.282 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:55.283 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:10:57.092 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:10:58.659 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:02.121 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:03.662 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:05.063 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:05.078 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:05.092 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:07.162 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:08.664 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:11.956 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:11.970 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:11.983 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 21.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:12.186 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:13.324 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:13.325 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:13.668 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:14.352 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:14.353 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:15.382 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:15.383 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:17.236 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:18.672 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:22.274 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:23.675 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:26.124 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:26.139 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:26.155 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:27.307 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:28.678 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:32.336 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:33.021 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:33.037 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:33.052 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 23.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:33.680 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:35.425 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:35.426 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:36.440 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:36.441 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:37.378 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:37.466 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:37.467 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:38.683 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:42.414 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:43.685 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:47.455 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:48.706 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:49.270 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:49.290 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:49.309 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:52.502 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:53.757 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:56.094 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:56.109 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:56.123 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 25.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:57.505 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:58.797 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:11:59.511 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:11:59.512 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:00.543 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:00.544 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:01.560 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:01.561 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:02.530 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:03.829 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:07.551 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:08.871 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:12.593 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:13.893 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:14.347 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:14.363 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:14.378 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:17.596 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:18.919 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:21.167 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:21.181 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:21.195 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 27.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:22.598 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:23.946 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:25.608 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:25.609 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:26.629 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:26.630 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:27.601 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:27.657 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:27.657 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:28.978 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:32.604 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:34.023 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:37.606 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:39.066 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:41.417 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:41.435 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:41.453 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:42.608 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:44.094 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:47.610 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:48.245 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:48.263 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:48.277 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 29.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:49.131 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:52.611 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:53.707 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:53.708 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:54.167 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:54.739 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:54.740 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:55.767 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:55.768 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548796.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:12:57.613 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:12:59.204 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:13:02.614 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:13:04.238 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:13:07.617 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:13:09.275 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:13:10.492 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:13:10.506 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:13:10.521 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:13:12.619 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:13:14.277 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:13:17.324 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:13:17.340 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:13:17.356 2 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] ECONNREFUSED (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:13:17.620 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:13:19.321 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:13:22.621 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:13:23.804 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:13:23.804 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [0c2b465c-f46c-4517-9cdd-9eee8d67b305] AMQP server on np0005548795.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:13:24.355 2 DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 __log_wakeup /usr/lib64/python3.9/site-packages/ovs/poller.py:263
2025-12-06 09:13:24.831 2 ERROR oslo.messaging._drivers.impl_rabbit [-] [4d61b2ce-4156-4e62-96d1-fcd4864aa3c9] AMQP server on np0005548797.internalapi.ooo.test:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-12-06 09:13:24.832 2 DEBUG oslo_concurrency.lockutils [req-971abd94-9f13-4f4d-a0ca-d3cfa46c8e00 - - - - -] Acquired lock "singleton_lock" lock /usr/lib/python3.9/site-packages/oslo_concurrency/lockutils.py:266
2025-12-06 09:13:24.833 2 DEBUG oslo_concurrency.lockutils [req-971abd94-9f13-4f4d-a0ca-d3cfa46c8e00 - - - - -] Releasing lock "singleton_lock" lock /usr/lib/python3.9/site-packages/oslo_concurrency/lockutils.py:282